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FOREWORD 


In 1969, Premier Harry Strom announced in the following terms the 
creation of an Alberta Commission on Educational Planning: 
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the Government proposes to establish a Commission on 
Educational Planning, a Commission with differences however — one 
that looks to the future, that will provide guidelines for change; one 
that will not spend its energy on criticizing the current operation of 
our educational institutions, rather one that will give leadership 
towards the self-renewal necessary to meet the challenge of the 
seventies, and finally, one that will look at the total provincial effort 
in education, at its schools, its colleges, its institutes, its universities, 
and its adult and continuing programs.” 


When the Human Resources Research Council was asked to serve as the 
research arm of the Commission, a comprehensive program of 
planning-based studies was initiated. 

One of the first activities in the program was to take stock — to assess 
the state of the art, to assemble and codify available knowledge, and to 
develop a conceptual framework for the guidance of the over-all research 
program. 

This monograph, Education Planning Reexamined, is largely the 
product of that stock-taking exercise. 

I express appreciation to Dr. Riffel for the painstaking effort he has put 
forth in assembling the materials, for the order he has imposed on these 
materials through his organization, and for the provocative manner in which 
he has interspersed these materials with his own ideas. 


L. W. Downey, Director 
The Human Resources 
Research Council of Alberta 


Digitized by the Internet Archive 
in 2022 with funding from 
Legislative Assembly of Alberta - Alberta Legislature Library 


https://archive.org/details/ableg_33398003116901 


TABLE OF CONTENTS 


PRETACE: ee Td ere naneiccs ey ERS «AG AIDES OES OTE bee l 


CHAPTER ONE 


BACT OM Bee, estan tit eee cos esc aba cd cadaeslsh Haaciadoeph i esniel caeek t= 2s% 0-4 3 
Pesonsot the ast Bittoen Years o. soi. ic sdsccs cise) sie vinses decd tua ¥D taaaatdecth on skst S 
Realigning the Organization of Education Planning ........................66 6 
pica Pesearcn ANd PUDMC PONG Y oa. 2e acca We ton naeerbiny ue Wace Si -ne'e an 6 
Educational Planning and Social Development .....................0000000060 i 
Reormanizie £ UONC LIC CISIOIPNidanane te ei er re re 8 
Measuring Educational Performance: Toward Social and 
EBC aa COUNTS, Sree ease UII, coca cceeveg is ieecnnsdessuesiaaieesoass 8 
Wuantiitative : ldnning Lechmaques Ml Perspective’... eet lies 8 
il sh es eG g 16/00) GUE bu coated turd aia er bae aa oe ore eo om a ay ata 8 
POAT er Vie WROL UTC MEIGTIORT ADI Serer tatc ron teeerecteeeteerestece ices Miecnane..erseth) 9 


CHAPTER TWO 


Toward an Optimal Model of the Planning Process .........................:::::00 11 
PASTS EEO Me OLE aMGASTOR PLATING oio..o0) cajuie in gisnnnsodideosvce soapan gos savves hing 1] 
Pe A asa pac dec bagosin de pnnnsnosocnscesendvnes iassevcgpenesouesinnmaraiihs 18 
PAAR NB OS ck Way Be Bret, 91> caval eds anins cease wie osiinde gs caipasess 20 
Ny aaa da BE sass he one eee 5 Lac ci dscns enaan org cu natbaceaee ee A sdawousep DG 


CHAPTER THREE 


The Influence of Circumstances and Ideologies on Education Planning .... 23 


DREAM eaMiZaATiON Gl POUCALION FLAMING pcc.ccs.rscccsnsvarcnsnpcuusscaesegaveuees die 24 
The Location and Structure of Public Planning Agencies ................. 25 
7 We FCOleS Ol ACtOTS M0 Le FIAMMNUNE PLOCOSS. 1005s. sack cnahaciacmcceysiteacteses 25 
POUCY Manets, Flanmers And) 5 ressure Us OUDS..n.cces cedgenscontwerorseter-+s¥ercanys 26 
PAU AVONIION A IVET: CIC ALIOE ot cacrs Secs beneiaetc keep recettysedaspossug toupee Pam 
Die Cita CONTEC Or PONCY, INNOVAION: a vpruepepryhtcacstenndtue advan sont 28 
Tie erative < naracter Of PAUCATION PIANNING oic..445jcccceaenageeees sage eon enee 30 
How Planning Organizations Function: Notes Toward a Model ............ 31 
Some Basic Questions About the Organization of Planning .................. 34 
RMU AS ONT rae seta a ty ta tadgrgeend cane a evnatisasd ovary sa xiganaten ghee 
peice) aNd AUER OT Me UEOMARINCIAU fey caick scstesaravonacs ah cadetssnirsavtensangusetsbian pos a8 
Peary ate EW EE ie carat fest rate ay nda vsaia sve muah anette Se bniecowtahas scigichyts 36 
WAR CNTR, Pe LOLITA oo janes foxy: vere! an aanseabanna gisdaesienansiesverds 36 


Re PT UPR ICISO Mette, EN eae tot TRIN on vc acinesavinawctsapassonpnbacnenas 37 


TABLE OF CONTENTS 


The Hietarehy ot Goals \\u.9.,3.c0leaecenec ee verrecinecay conecnie ns yee 37 
Interest Groups: Scag. des ncdescheeleved nest etc ee ec a 37 
Exterrial Intluenees ss essse iedeiie oeeeeecees  ee ee 38 
The Institutional Network ace ee 38 
Political Parties ey ae eee aa ecet tees ea cee nant eee Be 
Phe Decisioty-MaRIne PlOCese \ccccccstcegancceecktcete osenice sete conte nee anaes ao 
The Legality or Plansand the Kure OF Daw rc ccee ee ene 40 
AUTiti PEON erste ett cotctn ence cece nce et og teeta eee 40 
ACTIVATOTS ANG BANC UONS™. 11.50 elas g ener ere ier iad eae red Nee eee 4] 
Obstacles and Lintitations to: TmDle mentation ...,.iigece austere cece 41 
Correct mig MeCIaInisEs ty cec i515. sser tucker cet wae taumere sen ee taken 4] 
Grab ACIS VEIIOME LOi ls Gic vss ees sec tenuis cae dae yerate coke aie a eee 4] 
Bide EIT@CtS i... aeecazsscggsd ens nsdsdeseectsaurhe ee tiaeing dase eaten 42 
Fyatuatiomin Terms Or Valles 00, 2.cececuteatcnt ter cerstast ay tetas eee eee 42 


CHAPTER FOUR 


Information Systems for Education Planning .........................cccceeeeeceeeeeees 43 
Toward Redesign of the Education Planning Information Systems ...... 44 
CUNTONU PLACHICESS curs Sasol ac ctyeee cet eet eee lene tees sets aeae alten eee a4 

Studying the Information Needs and Uses 
OPE Gucatiom Planers ice toca cane ace cer eee 46 

Some Basic Alternatives for the Design of 
Planning Information: SVStem Seasescccecas cc ee a ee 47 
Databank S@rvides our cca8s: ctcca tee delegation ace en 48 
Modellitig Systems... c.5 <2. 5) culieee Siaea gee ie es nr 49 
Continuous process: Contyol |. y.0)io eco. ole ee a er 50 
Making Information Systems Work: Some General Guidelines ............. 5] 

Developing Social Accounts and Educational Indicators: 

On Guiding and Interpreting Educational Change. ................2:.ssssdeseeee- a2 
A Concept val MOG 0 oie, nase saa ect ob eee en asuaee atten ee al ave ae ee 54 
INSU LION AL ANGI CIVIGUALl SECLOLS oo isn csncod ae euan di chee ee ae 54 
Needs; eoals anclagtainine ne: U3 (2.0.24 4.sn.accrbecr acne eee eee 56 
Levelsin The Model: 0) c.daacee sec eoueeeelueiapeerecuueas tari eee eee 56 
Goals. Consensus2ang’ Vas «clays cole cua secant nuda ieee aa 
"The. Vale. GUICSTIO NS Ji ssid sswerasanthaacedeoegneouee ed one ieahs ae ae 58 
Structurnme Attammment Levels: :.. 23.100 eis etarat caus ce eee 2h, 
The isd vid Walt iis Meiud asc coe catee Sogleeemedpuuaesades a vaumea ee game ee Sp 


SOCICEY ives sceccdtvenns + cunandosdsenvcuunhans gueahetag hua densselees ug ee aetna ae a9 


TABLE OF CONTENTS 


EaducationalindicatOiy 4. NUS Site Cle ISihe VO DOSES JOM UI esses 60 
EE SOOM NTO See tia oe Lee CROCE Be Ree LEME SACO i oerel BISA Sess 60 
The socialipunposes of-edmeationmrds. MONS. AAR Von 61 
AUOaION AL Aclaineneniy 5, smero. ee MI We 2 BEML fD.. 62 

The Educational View -AGHiter 2 RUMSIN RA BON. AA Aad. 62 
Linking Accounting Procedures and the Planning Process .................... 64 


CHAPTER FIVE 


Improving Resource Allocations in Education ........................ccccccceeeeeeseees 67 
Toward Designs for Rational Decision in Education ...................0.c:066 67 
Systematic Analysis and Resource Allocation 
Decisions: Summary Comments on Selected Methods ...................... 69 
Cost-Benetiti Analysis. 4ii)is.. smash net OL gt dl. 71 
Mndérlyins Prnciplestuininin aay, aco k Bi talad. oF eAURabA.. a) 
IdentMCalion OL COSIS ald GeNerits, .......5. een a. nBOURUON....<. 73 
Valuation. of costs.and .beneritsors saitgihi. isis ok WOke....:. 74 
Cheimoehmierestrategniieceniy sd teigod, whl. iohoaw. ep tA 75 
Reetevalyt COs ams ht 8 Ae Sens, Wale ETE ONL RUA; 76 
Conmntine Cortroversiest: acy: examen ta DAT. Jt 76 
Applications of Cost BenehitAnalysise:. (40 tilde chy. TEP... 78 
SURT VAL GN OIC INES” eet eepsk Gane casicaycasselsvsancntcstes te sngene Mee eee SEM ee 79 
PBR et LOGIN VEMIORS PA MIAL VS 16s ede sasnip sien ciayachia-scunetier niucxbuicds ssoeasdogh Uraakovon) 79 
Ree ING ATARI hanes gee asa hic kak (iss gciy pen tuarbimasece 80 
The Process Of (ne ANAIVSIS sinensis. netent ite arse acid cena athe) 82 
Applications in the Design and Analysis 
OnE Gucanorial POC ranis (VOI ASTs,.. BAL). Ro. A eat ee Mt dae 84 
Ei Vo gk Tl oy ERS AA RM ede | RET oe SN ete tice Ss in 86 
Be aT RAY Be oN beste dy ena sScess Mead etwuguaacs4 ee bogvabeaategeolsseathandungisecs 86 
LUE Atay SISA ECONOMICS jad s5e. 0 eucegt cs, csseveeadadanayenaneehs soe 87 
A OEE OTT GAUL Re crn ators bo nnignpy <itn ceo nilapwbaceesanaesayihemecdupiy 88 
SUTRA UOC: avis: ala keye chats --aasurs.. wich tiisielie wdc: 89 
Planning, Programming and Budgeting (PPBS) in Education ................ 89 
CUE ie Mie Ea goo lal ld he Bile cl, My il ct Rea ls SR ha 91 
Latico k Patan BUC etl sccss oh cases secsnenecdstys-cracdnasnevesaqavntrtas 92 
COnciuaing NOTES: SOME Manageiicnt ISSUES. 4. ous. gs i oraseaascd sanenergot snappers 93 


CHAPTER SIX 


Linking Education Planning and Social Forecasting .......................00000000+ 95 
PROTO 10s Bla RRC ARTI ie i ia to) py ha ate inde Sncakaanedinndaaed toeskanadie ss 7] 


TABLE OF CONTENTS 


Prediction Based on Analysis: Some Early Forms ..................0:20c0000 98 

Some Recent Developments: Social Accounting and 

Systematic Huturology ...:....\. sedans tua iy cereus desta Cae roca, 101 
A Preliminary Framework for a Social Forecasting System ................ 103 


Linking Futures and Education Planning: 
Some, Summary Ay OME ihe. ios socks soeeaa cel weetnepa danse ata aeeen 109 


CHAPTER SEVEN 


Fitting the Pieces Together: The Possibilities for ‘‘ Second Generation” 


Planning in Education cig4))44-18. detiaisekd Gaeta ak Se eae 111 
Social Research and Educational Poligya 0.4... aiuee ni pepo 111 
Eliminating the Obstaclesia. WA ZINN) eee eee 112 
The Development. of a Policy. Science..:.....:) gene eres 113 
Adjusting the Roles of Actors in the planning Process .......................- 114 
Boundary, Personnel ......... 2/90. EE RIM TY ea hl i) 
Roles in the Policy. Making Processcei. baa 2iaok a woke... LS 
A Last Model: Building Social Forecasting, Social Accounting, and 
Quantitative Analysis into Educational Policy Making ....................... 120 
Loward- Implementation: ::..:.2.::..2:2.c1esanmhamuepany eet ates wee c 122 
CONClUSION 40. .eiscsis cies ace meena re iO, tails Eek an Sem 124 
REFERENCES 
(CaplemOne us baccsscceunszes smerecateu nec ane ene navn esa serie ae ecer eta ee ae 125 
APLC TW yi re casas sc os diene ens sd Sea REN OAC gM te ae ee ee 125 
Chapter Taree eho. scascie coc vedcursatsenegeeeeauqersentaeceg ee ene ae ot oase paler toe eee eee ee | ass 
Chapter Pour rec c38 eas etal, ota Sade testers eaten ae ae 136 
Chapter Five icics.s cass cctenas cheats aa cane ackeg eeu Uae Sa re ee oe ee 143 


Chapter Six.» gile.augeunassecanncteeior< hag Cae es sake ee f52 


PREFACE 


There is a tendency today to overemphasize planning. It is commonly 
described as a panacea for overexpenditures on the social services, for lack 
of coordination, indeed for the improvement of the whole of the human 
condition. 

Actually, such claims are not entirely well-founded. Planning is not 
always appropriate — we do not know enough. It is not always possible — 
effective means for implementing plans are not always available. And, it will 
not always be successful — too many factors rest outside of the control of 
planners (Thank God!). 

But some problems are real and demand solution. And man will always 
have his hopes and fears, his far-off utopias, and the hard realities of the 
present. 

So we will continue to try to plan and to create an instrument for 
rational, deliberate social choice. Our efforts will not be perfect, for that is 
not possible, but they can be conducted in such a way that planning will be 
as good as possible in most situations and that it might constantly improve. 

How? Can an optimal planning process be identified, a process 
consonant with the pluralism of society, with the present political system, 
and with the need for rationality and an orientation to the future in public 
life? Can we work systematically toward achieving such a process? 

This monograph is an effort to answer these questions by outlining the 
elements of one kind of answer and, at the same time, by providing the 
reader with leads for finding his own answers through extensive lists of 
references. The argument is straightforward — the guidance of educational 
systems calls for a much broader logic or rationality than is usually shown 
by politicians, social scientists, statisticians, futurologists, or administrators 
alone. The logic of contemporary planning must be rough and ready, able to 
deal with an almost overwhelming number of variables and hard-to-resolve 
normative issues. It must be a heuristic sort of rationality, tempered by the 
heat of political conflict and compromise, not the comfortable but 
dysfunctional rationality of predetermined policies and calculations. 

My approach has been ambitious — I can probably be accused of 
overstating my case for the new planning. And yet, much can be 
accomplished if agreement can be reached on the redesigning of policy 
making, if planners and policy makers can work persistently and 
systematically toward this new design. 

The origins of this book can be traced back to early 1969 when the 
Human Resources Research Council staff considered the development of a 
comprehensive program of research on education planning. At the time, the 
idea of an in-house research program was set aside, and the Council 
supported the establishment of a provincial Commission on Educational 
Planning. The Commission was formed later in 1969, with HRRC named as 
its research arm. And so, eventually, HRRC came full circle to an in-house 
research program which would meet the needs of the Commission as well. 


Many of the ideas contained in this book were first set on paper in two 
early HRRC documents. The first was by L.W. Downey: ““The Role of 
Research in the Commission on Educational Planning.” The other was 
written by me in collaboration with E.J. Ingram and H.J. Dyck: “The 
Challenge of the Seventies: Planning Education for the Decades Ahead”. 

The title of this book was suggested by Yehezkel Dror’s Public Policy 
Making Reexamined. In fact, the influence of Dror’s work can be seen 
throughout my writing. 

Finally, I am indebted to R. Gordon McIntosh for his editorial 
comments, to K. Wilson for his assistance with parts of Chapters Four and 
Five, to L. Klimek for allowing me to use her bibliography on “Studies of 
the Future”, and to Mrs. E. Burns for typing the manuscript. 


CHAPTER ONE 


INTRODUCTION 


Educational systems and the structures they develop are products of 
accident and necessity, of distant dreams and unavoidable pressures. While 
systems have had their promises and charter principles, today the pressures 
of opposing social forces and hard economic facts are bringing educational 
policy makers and planners to the difficult realization that although 
education has prospered greatly, even the most basic assumptions on which 
the systems rest are now being questioned. They are discovering that the 
unlimited financial and moral support which education once received, and 
which some of them continue to expect, will no longer be forthcoming. 

Many of the roots of these difficulties are buried in history. The ideal 
of universal education is an old one, but its framers and supporters were not 
prepared for the phenomenal population growth that followed World War 
Il. Those who set precedents for massive expenditures on public education 
did not expect education to come into competition with a host of new 
priorities — public health care, urban renewal, and pollution control — and 
were caught off guard by the competition. Those who created large 
bureaucracies for the management of modern education did not foresee the 
alienation and disaffection with public agencies that was to come in the 
1960’s both among the older generation, who became skeptical of 
traditional institutions, and among the young, who actively opposed them. 

As a result, contemporary educational policy makers and planners must 
deal with long-standing problems — like the continued growth of 
enrolments, the proliferation of educational institutions, and educational 
inefficiency — and also with questions that were not being asked with any 
urgency a decade ago, questions reflecting the erosion of traditional 
authority, public disaffection with education, and the need to economize. 

Moreover, it seems certain that the social, political, and economic 
trends which strained the capacity for change of educational systems in the 
1950’s and 1960’s will continue and perhaps intensify in the 1970's. If these 
problems are to be the pre-eminent concerns of policy makers and planners 
in the 1970's it follows that the time has come to consider seriously the 
problems and prospects for guiding the growth and development of 
educational systems. 

This is more easily said than done, and critical questions remain: 
“How?” “Where can policy makers look for assistance?” It is clear that 
continued first generation planning! will not be effective. While early 
attempts at planning enjoyed a fair measure of success in grappling with the 


lFirst generation education planning followed the now commonplace cycle of 
projection, need identification, and short-term adjustment. Even where conditions 
were fairly conducive to effective planning, attempts to follow this model were beset 
by difficulties: the planning function was not tied closely enough to public policy 
making and administration; planning often went forward independently of budget 
Continued 
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traditional problems of growth and expansion, such methods are not suited 
to the new problems facing policy makers. 

At this time, however, there are no simple or definitive alternatives to 
first generation planning in education. So, instead of trying to find such 
simple solutions, it seems more appropriate to outline an approach to 
solving public issues, an approach which captures the essence of public 
decision making in our society and which makes the most appropriate use of 
all of the problem-solving tools at our disposal. Of course, the old problems 
will stay with the planner. The task, then, is to develop a means of policy 
making and planning which is suited to both the old problems and the new 
issues. 

The main aim of this book is to outline one approach to grappling with 
the task of redesigning policy-making and planning in education. In the 
simplest terms possible, the central argument is that the education planning 
practices of the past and those which dominate the present are not 
adequate. Nor would an idealized alternative to present practices be 
acceptable, for such distant utopias can seldom, if ever, be reached. But we 
can learn from past efforts and try systematically to improve upon their 
strengths and eliminate their weaknesses. 

In the past, and too often in the present, attempts to plan have turned 
on one or both of two questions: “What is?” and “What ought to be?” 

When the focus is “What is?” the purpose of planning is to set right the 
present, to redress grievances of the immediate past. It tends to be 
crisis-oriented and sporadic, dealing with issues as they arise. 

When the central question is “What ought to be?” the purpose of 
planning is to capture the future and to hold it on behalf of a particular 
value or moral standard. It tends to be utopian, highly subjective, and 
missionary in its conduct. 

These two approaches to planning have similar failings even though 
their starting points are so different. They suffer from all the defects of first 
generation education planning, from a lack of comprehensiveness, and from 
simple-minded views of issues. And, too often, they fail, for they do not 
take into account the first two laws of planning — “Planning leads to 
anti-planning,” (Ewing, 1969) and “What can go wrong will go wrong,” — 
and are not equipped to deal with the possibilities. 

There is a third planning question: “What might be?” or “What if?” 
When added to the first two questions, it greatly increases the possibilities 
for effective planning. Of the three planning questions, answers to this one 
alone enable the planner to be open to the unexpected and responsive to the 
unforeseen. 


making; decisions made at a local level were often inconsistent with provincial policy; 
education planning was usually isolated from planning for other social delivery 
systems; and so the list goes on. The terms “‘first” and “‘second generation education 
planning” were first coined by the staff of the Organization for Economic Cooperation 
and Development. 
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So much for now about the new and old approaches to education 
planning. The outlines sketched above will provide the starting point for the 
analysis and model building in the balance of this book. From this 
preliminary framework, the various features of a redesigned planning 
process, which thus far have been mentioned only briefly, will be considered 
in greater detail. 

Before moving on to the main discussion about planning, some caveats 
about the material to follow must be articulated. Planning is a continuing 
process more often than not carried out at the same time as other processes 
in guiding educational systems and seldom set apart completely from these 
other processes. Thus, it can be difficult in practice to say what is planning 
and what is not, who is a planner and who is not. While this untidiness 
might be disconcerting to some readers, it is essential to regard planning as a 
process which involves various individuals in various roles, to various 
extents, and in various ways. For convenience in writing this book, repeated 
reference has been made to the “education planner” and the “educational 
planning agency.” These later references must be understood in the context 
of planning as a multi-person, multi-role process. 

Because the generalizations and speculations contained in the balance 
of this book are drawn from so many diverse sources, they are vulnerable to 
the extent that they may not necessarily apply to specific situations. 
However, no generalization in the social sciences can account for all of the 
special features of individual cases. The generalizations, then, make up one 
path that can be taken in the journey to the future of educational planning. 

No attempt has been made to differentiate sharply the kind of planning 
at the various levels of the educational enterprise (for example, differences 
between secondary and post-secondary education), that which is done for 
different elements of the educational process (for example, distinctions 
between planning curricula and facilities), or that which goes on in different 
jurisdictions (for instance, local, provincial, and federal). The approach to 
planning discussed here is, broadly speaking, applicable to virtually any 
planning problem. While specific procedures may not now be usable for 
given problems, the general principles, the attitudes, conveyed about the 
planning process seem to be broadly relevant. For example, because of 
methodological limitations, a mathematical cost-benefit analysis cannot be 
carried out at the school level, but the basic idea of trading off expected 
costs and benefits applies and can be used, even without the comforts of 
mathematical precision. 


Lessons of the Last Fifteeen Years 
In spite of their shortcomings, or perhaps because of the early attempts 


at planning, education can offer much to those who would try to develop a 
new approach to planning. Many of the basic questions will remain the 
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same: Who decides? What must be changed? What can be accomplished? 
What must be taken into account to improve the operation of educational 
systems? To a great extent, the same agents (politicians, civil servants, 
representatives of interest groups, and so on) will be involved in the 
policy-making and planning processes. Many of the same planning 
techniques or perhaps more sophisticated versions of them will be 
employed. 

At the same time, agreement is emerging on what is required to improve 
education planning in the contemporary context. The four points of 
agreement discussed below are the real lessons to be drawn from planning 
efforts in the last two decades. 


Realigning the Organization of Education Planning 


According to Combs (1968), “the managerial arrangements typical of 
educational systems are grossly inadequate ... They were not designed for 
planning in today’s sense of the term, or for implementing such planning, or 
for critical evaluation of the educational system’s performance, or for a 
rigorous promotion of innovation (p. 120). Thus, one of the most 
important preconditions for innovation in education planning involves 
bringing educational management into step with contemporary social 
concerns and challenges to the system. To do so requires movement forward 
along three fronts: strengthening the connection between social research 
and social policy; creating closer links between education planning and 
social development in general; and reorganizing the public decision making 
process itself. 


Social Research and Public Policy. Some time ago, Thorstein Veblen 
wrote: “‘a scientist is addicted to the practice of idle curiosity” . This 
half-facetious definition states in a compelling way the classical posture of 
the social scientist. But the public need for the utilization of the findings of 
social research is increasing rapidly and is impelling a closer connection 
between social scientists and policy makers and planners. 

Because such collaboration is only a very recent phenomenon (but one 
that is steadily gaining momentum) it is difficult to predict with any 
assurance of accuracy what its consequences will be, either for policy 
makers or for social scientists. And, although it may be too early to begin 
formalizing the strategic planning of science, a search for a policy for the 
sciences should be undertaken immediately. This will not be an easy task. 
According to C.H. Waddington: 


if society is to find ways of making maximum use of science for 
the welfare of man, it will have to exert control over two different 
levels of activity: it will have to ensure that research is carried out 
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into all the fields of major importance, and it will have to direct 
social action in such a way that the new knowledge is exploited 
and applied to the best purposes. We know a good deal more about 
how to tackle the first than we do about the second, although even 
as regards the rational direction of research no country has yet 
produced a decision making system which is _ reasonably 
satisfactory. 

(1969, p. 106) 


Educational Planning and Social Development. Many major 
deliberations on public policy involve social questions pointing to the 
reciprocal effects of education and social change and progress. The 
translation of social goals into development programs often requires the 
determination of a role for the educational system. There is growing 
awareness that educational programs usually have to be planned with the 
probable impact of likely social changes in mind. In short, the number of 
occasions demanding a closer connection between educational planning and 
planning in other sectors of society is growing. 

These summary comments indicate that this reciprocal relationship 
must be accounted for in the process of planning education, if educational 
developments are to reach desired objectives. The full range of questions 
bearing on this problem is so broad that they must be left outside the scope 
of this discussion, but the essential question remains: “How can the 
education planning process be structured to ensure adequate attention to 
the link between education and social development?” 

In the first place, those who plan for education must survey the social 
structure which their plans are designed to serve. Social goals and the need 
to cope with significant social problems often provide the planner’s point of 
departure by indicating what action is required. The economic, political, 
and social capabilities of the system define the limits of the planner’s 
interventions and the capacity and willingness of the system to make 
planned adjustment will govern the impact of the planner’s efforts. 

Second, because social objectives for education often carry with them 
subjective staternents about the quality of education and social life, a forum 
for debating these norm-laden judgements must be created. In a pluralistic 
social system, qualitative priorities are set politically; the difficulty is to 
build this debate into the planning process so that issues can be handled 
explicitly. Otherwise, questions of equality will be kept at an implicit level 
where they cannot be dealt with effectively. 

Finally education planning must be linked with planning for economic, 
social, and political development. Unless the education planner is aware of 
these contexts, he cannot identify important trends and needs and 
consequently cannot develop realistic programs. 
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Reorganizing Public Decision Making. Every education system has a set 
of traditions and laws which outline its preferences for a way of making 
decisions that seems “‘right”’. The preferences particular to the system define 
its characteristic methods for handling social issues and creating public 
policy. In the face of rapid social changes and unexpected challenges to 
traditions, however, such preferences can hinder prompt and effective social 
action. So there is a need to ask periodically questions like the following: 
Where should public decisions be made — in Parliament? in the market place 
of competing ideas and ideologies? What is the mix between them to be? 
Who will make these decisions — elected representatives of the people? the 
Cabinet? the Civil Service? special interest groups? private individuals? How 
are plans to be implemented? How and where might opposition to plans be 
expressed? 


Measuring Educational Performance: 
Toward Social and Educational Accounts 


Public policy is frequently outlined in grand terms — John 
Diefenbaker’s “New North,’ John Kennedy’s “New Frontier,’ Pierre 
Trudeau’s “Just Society,” and so on. While these slogans imply certain 
social directions, they offer little guidance to those responsible for 
developing specific programs. There is a need to examine the aims of 
educational policy, to determine where we stand in relation to those aims, 
and to decide what can be realistically done to further progress toward 
those objectives, given other competing public priorities. 


Quantitative Planning Techniques in Perspective 


A number of disciplines, principally economics, have devised a variety 
of techniques which can be useful in planning education, including 
cost-benefit and cost-effectiveness methods, simulation techniques, and 
improved budgetary procedures. Although education planning will never 
become simply a process of summing up the results of studies using these 
quantitative methods, these problem solving tools can help policy makers 
distinguish among high and low priority programs and allocate public 
resources more effectively. 


Foreshadowing the Future 


Presently, most planners work with only a minimum knowledge of the 
future — knowledge about current commitments and intended policy. 
Experience has shown that even these expectations can fail to materialize 
because of the effects of unanticipated conditions or factors which cannot 
be controlled. If short-term forecasts are so fallible, what then of long-term 
anticipations? 


INTRODUCTION 


Yet, some form of social forecasting, of anticipating social change in an 
era of seeming exponential change, must be woven into the fabric of the 
planning process, both to forecast the likely progress of planned programs 
and to estimate the consequences of their realization or non-fulfillment. 
Thus, the problem is to learn enough about the mechanics of social change 
and the art/science of social forecasting to be able to anticipate the likely 
course of events. 

In the last five years, the field of futures study has moved ahead 
remarkably. While futurology is no substitute for sound analysis, it holds 
great promise for making planners more sensitive to probable social changes. 
And, in addition to helping us identify what is probable, futures study can 
be used to point to desirable future conditions and to suggest what is 
possible. Its potential for suggesting the probable, the desirable, and the 
possible is precisely why the study of the future can and must be 
incorporated into the planning process. 


An Overview of the Monograph 


Although it would be possible to develop this monograph around a 
detailed discussion of each phase of the optimum model of the planning 
process described in Chapter Two, such detail would prove tedious and 
would contribute little to the purposes of this book. My basic purposes are 
to consider the meaning and implications of the lessons outlined above for 
contemporary education planning, to review research related to these four 
themes, to ask some fundamental questions about education planning, and 
to develop comprehensive lists of references on each of these topics. 

Thus, my concern is with characterizing education planning, not as it 
has been, but as it can become. This is not an easy task, for the existing 
research on planning reflects the lack of rigor of the discipline. The quality 
of available data is uneven and often more speculative than representative of 
actual practices. Research reports move back and forth somewhat too freely 
between normative judgements and descriptions of what was observed. The 
units of aggregation examined vary greatly, from individuals to complex 
social planning mechanisms. Few studies have yielded generalizable results — 
most are case studies which are difficult, if not impossible, to relate to each 
other. I have tried to identify the most promising directions of 
contemporary thinking about planning, and to arrive at a balance of 
operational and speculative analysis, of case descriptions and attempts at 
modelling, and of normative and descriptive elements. 

The monograph has six chapters following the introduction. Chapters 
Three to Six are divided into two sections: a discussion of basic notions 
surrounding each topic and a list of references, placed at the end of the 
monograph. 
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Chapter Two contains a brief outline of a model of the educational 
planning process. Essentially an attempt to describe the “new educational 
planning,” the model emphasizes four aspects of planning: (1) the social 
and institutional context in which planning takes place;(2) taking stock of 
educational and _ social development; (3) social forecasting; and 
(4) rationalizing the planning process through the balanced use of 
quantitative analysis. 

Chapter Three paints a broad picture of contemporary social and 
political forces which influence the organization of planning and shape the 
outcomes of the planning process. A tentative model of the behavior of 
planning agencies is developed and used to guide the formulation of a rather 
lengthy list of basic questions about the organization of planning. 

Chapter Four contains a discussion of information systems for 
education planning. Its major purposes are to demonstrate that new 
conceptions of information systems are required when planning is defined as 
it is here, and to point out some recent developments which will be useful 
to this end. 

Chapter Five outlines the contribution that can be made to education 
planning by certain quantitative techniques, principally those drawn from 
economics. Its central argument is that neat quantitative solutions to 
planning problems do not exist, but that these tools, when used wisely, can 
prove to be a powerful complement to the planner’s judgement. 

In Chapter Six an attempt is made to develop a model for the 
integration of social forecasting and futurology into the planning process. 
The chapter argues that the usual sort of projections are no longer adequate 
if the planner is to obtain adequate images of the likely course of future 
events and that, the present shortcomings of the art/science of social 
forecasting notwithstanding, interweaving the two at appropriate points will 
pay real dividends to the planner. 

Finally, in the concluding chapter, some key considerations about 
improving education planning are reviewed. Discussion of them concludes 
the monograph. 

As the reader will shortly realize, this work is only a beginning. On one 
hand, the monograph attempts to develop some generalizations about 
education planning and posit some models for understanding planning more 
clearly. On the other hand, it raises more questions than it answers. It is 
hoped that, through these two emphases, readers will discover in the paper 
insights, if not answers, to some of the outstanding problems in the planning 
of education. 


CHAPTER TWO 


TOWARD AN OPTIMAL MODEL OF THE PLANNING PROCESS 


Three themes run through the many criticisms of most early but now 
commonplace approaches to planning education. The first focuses on 
particularism — educational planning has usually been conducted by small, 
isolated groups in the context of narrowly-defined educational studies, 
rather than within the framework of a comprehensive, integrated approach 
to social planning. It has been concerned with the peculiar characteristics of 
individual educational systems rather than with general principles which 
might apply in a variety of situations. 

The second points to its non-theoretical character; few attempts have 
been made to investigate empirically the relations or causal connections 
among social, political, and educational phenomena. 

The last criticism has been directed at the legalism of educational 
planning; planners tend to concentrate on government institutions and their 
legal norms and regulations, rather than on the actual performance and 
behavior of the educational system. 

To attempt to remedy only one of these shortcomings would be a 
misleading, perhaps fruitless, undertaking. The improvement of both the 
theory and practice of education planning depends on the correction, or at 
least alleviation, of each of the three. 

At the core of planning is a complex of factors that vary 
simultaneously. Consequently, the improvement of planning requires an 
approach stressing processes and relationships among key variables, not a set 
of specific techniques or a series of “‘do’s and don’ts” about organization. 
The theoretical and practical innovations needed in education planning 
should have the following characteristics: 


1. a more comprehensive view of the education planning process, with 
every effort made to overcome the tendency to particularization and to 
arrive at a more balanced representation of disciplinary specialists and 
policy makers in educational planning; 

2. precision. Past experience with overly intuitive methods of 
education planning indicates that more rational and scientific approaches to 
the problem of planning educational systems must be found; 

3. realism. If the dynamics of educational planning are to be fully 
understood, all of the structures and processes actually involved in planning, 
policy making, and program implementation must be examined, and not 
only the formal institutions and legal norms pertaining to educational 
planning. 


A Brief Profile of Education Planning 


Educational planning involves the study of educational priorities, 
alternative ways of achieving them, probable future conditions, and 
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contingencies and how to deal with them. The purposes of planning are to 
examine critically alternative courses of action, to stimulate ideas about 
warding off conflicts between competing priorities and about strategies for 
managing programs, to identify problems, and to generate data to be used in 
evaluating programs. 

From a somewhat different vantage point (Heufner, 1967, p. 17) 
education planning can be viewed as a combination of four elements: 

1. a management tool to support decision makers by improving 
procedures for setting educational priorities and guiding the implementation 
of priority programs. 

2. a coordinating tool to improve the organization of the components 
of programs and to articulate the programs with other activities outside of 
their immediate scope. 

3. an up-to-date guidance system which will allow programs to be 
responsive to changing circumstances, but which will be firm enough to 
assure the continuity and consistency of programs. 

4. a source of the best information and most competent personnel for 
each phase of the planning process. 


An Optimal Model of the Education Planning Process 


A currently evolving view defines educational planning as a: 


... developmental process in which several levels of intellectual 
undertakings are in constant interaction. Although a logical 
sequence may be listed, it is not necessarily a temporal one. Even 
as we organize for planning we must provide for the interplay 
among levels. For our concern with assuring a planning outcome 
which gives appropriate weight to all relevant elements implies a 
readiness to refine and revise the outcomes of earlier stages as we 
move into larger ones. (Kahn, 1969, p. 60). 


This view of planning as a process constitutes a sharp, much-needed 
departure from the traditional, purely logical, notions of education 
planning, “not so much in finding different elements in the planning process 
as in emphasizing different relations among these elements, and in seeing the 
process as having a radically different context, dynamics, and outcome 
(Sibley, 1970, p. 2)”’. 

What, then, are the essential elements, explicit and implied, of Kahn’s 
statement on the new perspective on planning? In the first place, planning is 
now thought of as a continuing process, not one started at whim or under 
pressure and finished when a blueprint of programs is drawn up. 

A second feature is that planning is regarded as an iterative process. As 
plans are brought toward implementation and after they have been put into 
effect, they are recycled and revised to accommodate changes in the system 
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and its resources or to correct errors in the initial plan. The product of a 
single planning cycle is thus, at best, a series of steps toward a set of 
objectives, and as one cycle follows another, it becomes possible to 
approximate the hoped-for state of affairs ever more closely. 

A third development, closely related to the first two, is that the base of 
involvement in planning has been broadened considerably. Partly as a result 
of the popular dictum that all those affected by a plan should take part in 
formulating that plan and partly as a reflection of the complex 
interorganizational networks in education, planning now involves many 
persons and organizations, not only the public officials actually responsible 
for the planning function in government.! In most provinces of Canada, for 
example, the organizations most concerned with the operation of the 
educational systems — departments of education, teachers’ organizations, 
associations of school trustees, and universities — have frequent, often close, 
contacts with each other. Through these contacts (particularly through an 
intricate overlapping committee system) these agencies play a central role in 
planning as they make demands of government, support its actions, or try to 
influence the course of the planning process. 

Fourth, the contemporary view of education planning requires an 
integrated approach to problem solving which draws experts from a variety 
of disciplines and which surveys as many as possible of the relevant features 
of the total system. For example, much will be lost in university planning if 
academic, physical, and financial planners are allowed to function in 
isolation from each other and from what is being done in secondary 
education and municipal planning. Of course, a complete analysis of all of 
the possible interrelationships among the various factors is out of the 
question. But the planner who ignores the most strategic relationships runs a 
high risk of having his programs go far off course, or worse. 

Fifth, contemporary accounts of education planning highlight its 
evaluative character. Each cycle of the process begins with an appraisal of 
the current state of the system and existing plans, and similar judgements 
are required in all subsequent stages as decisions are made about alternative 
plans, about the relevant parameters of a situation, about plan 
programming, and about ratification. Furthermore, since the basis for 
planning judgements can seldom be found in observable data alone, 
evaluation is defined broadly, not in terms of simple measurement. 

A sixth characteristic of recent descriptions of planning is their 
emphasis on the creation of alternatives as the critical task of the planner. 
The objectives pursued by planners can seldom be completely clear, 
consistent, or constant. Demands for services and the supply of material and 
human resources are subject to too many contingencies to be fully 


1] will refer to all of these persons as “‘actors” or “agents” later. 
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predictable. These uncertainties contribute a strong element of risk to 
planning, and require the planner to be prepared to adjust to unexpected 
conditions, 

There is another sense in which the planner is a creator of options — the 
political sense. In most nations the planning process assists the policy 
maker, who ultimately decides what course of action to follow by selecting 
one of the alternatives presented by the planner, or by returning the planner 
to his task until a suitable plan emerges. 

A final feature of “the new planning” is its longer time perspective. No 
short-term plan can reasonably be adopted without some idea of its 
long-range implications — the converse is also true. It would be satisfying to 
think that such prescience can always be achieved. But this is not the case, 
and anticipating both the consequences of planned activities and the impact 
of general conditions on the intended program remains one of the most 
difficult, basic tasks of the planner. 

This list of the principal features of contemporary perspectives on 
education planning paints a somewhat static picture. Some of the dynamism 
of the process, how it moves and develops, is represented by Figure 2.1 and 
summarized in the following discussion.2 This model is not intended to be 
representative of actual planning practices. Rather, the model presents a 
generalized view of the stages in the planning process; it is one way of 
understanding what happens when educational plans are formulated. The 
model can be applied to most levels of the educational enterprise — local, 
provincial, or federal. For the present, at least, the questions raised in the 
remaining chapters of the book are most pertinent to the two higher 
jurisdictions. 


Stage 1. In the broadest sense of the term, planning involves four main 
phases: (a) creating a mandate for planning or developing a policy to direct 
planning, (b) planning how to plan, (c) planning on substantive issues, the 
most common usage of the term, and (d) replanning; that is, making 
changes in current plans based on feedback about the execution of existing 
programs. In Alberta, for example, the first and last two of these phases 
have been carrried out usually as an implicit part of public administration. 
Occasionally, royal commissions have been established to make substantive 
recommendations to government. The second phase, planning how to plan, 
is now being examined by a special Commission on Educational Planning. 
The Commission’s report will focus on the development of structures and 
processes for education planning. In this sense, at least, the present 
Commission is significantly different from its predecessors which were most 
concerned with substantive issues in education. 


fi have made extensive use of the work of Alfred J. Kahn (Theory and Practice of 


Social Planning, 1969), Robert Dahl and Charles Lindblom (Politics, Economics, and 
Welfare, 1953), and David Easton (A Systems Analysis of Political Life, 1965). 
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These phases, with the possible exception of the last, seldom take place 
as a matter of course. More frequently, they begin after demands and 
supports have been assembled within the interorganizational network or 
planning set and communicated to the planning agency; they are initiated 
after feedback about existing practices or the need to create a new mandate 
is recognized. 

These demands and supports may come from a variety of sources but, 
of course, not necessarily the same sources in every case — individuals, 
government, organized interest groups, or the planner’s own perceptions of 
the state of the educational system at any given time. Each actor in the 
process has his own perceptions of what is, and his own images of what 
should be, and each has his own means for making demands and supports 
known to the planning unit. 

Relations between the planning agency and other organizations 
involved in the planning process are always complex, but tend to be 
exceedingly so when a planning cycle is being initiated. The agency depends 
on other organizations for various resources and for the legitimization of its 
mandate. Its performance is evaluated in terms of external referents. Its 
membership, particularly at the level of advisory committees, overlaps with 
other organizations. Financial resources are highly concentrated in the 
public domain and control over them rests outside the agency itself. 

The main inferences to be drawn from such a view of the instigation of 
planning concern both the significance of the structures, channels of 
communication, behavioral styles, and changing social conditions which 
influence the initiation of planning and the division of labor in the planning 
cycle. Planning takes place in the give and take atmosphere of contests 
between governments and organized interest groups, between reformers and 
persons concerned with maintaining the status quo (or at least changing it 
very slowly). The conduct of these contests, whether heated or quietly 
reasoned, sets the tone of the planning cycle. University administrators and 
planners, for example, are being forced to spend an increasingly large 
proportion of their time at such political activities, attempting to deal with 
radical students and faculty members trying to engineer change through 
heated confrontation, with more moderate students and faculty members 
seeking a greater voice in university affairs, with governments concerned 
about rapidly increasing costs, and so on. These pressures put great strains 
on the university and are politicizing the roles of its administrators and 
planners. 

In short, the initial questions in distinct planning cycles are seldom 
decided on criteria of rationality; they are unavoidably political and the 
conduct of this political activity sets the tone of the following stages of the 
planning cycle. 
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Stage 2. Once the process of planning has been set in motion, 


‘«., the planner’s most serious decision and major contribution is 
what may be called the formulation of definition of the planning 
task. The ‘task’ is formulated through a constant playing back 
between an assessment of the relevant aspects of social reality and 
the preferences of the relevant community. Each of these two 
factors affects and modifies the perceptions of the other. The task 
definition appears as an integration of the two. Much else in social 
planning follows from such integration (Kahn, 1969, p. 71).” 


The definition of the planning task also has a quantitative aspect which 
is dependent on operational objectives and the feasible use of system 
resources. Thus, the definition is subject to the limitations of the current 
economic, social, and technological capabilities of the educational system. 
In most circumstances, the problem is likely to be resolved into a question 
of whether, in view of the social and technological constraints of the 
situation, certain tasks can be financed, organized, and motivated. 

Once the preliminary political and rational-quantitative definitions of 
the planning task have been reached, the planner has established an initial 
set of standards enabling him to begin the continuing processes of defining 
the functions of the planning system, selecting the most appropriate forms 
of intervention into the educational system, determining the features of the 
educational system which might be manipulated with greatest impact, 
estimating the costs and benefits of different programs, assessing the social 
and opportunity costs of alternative interventions into the system, and 
making other policy choices to the formulation of an educational plan. 


Stage 3. Any planning process is a means for dealing with differences 
among goals and with conflicts over scarce resources. The result of the 
process of task definition is an initial resolution of these disagreements, a 
statement of policy or a standing plan. There is no guarantee that this 
standing plan is internally consistent or in harmony with other plans 
developed by the agency. Nor does this standing plan usually take a 
“maximize” or “minimize” form; most often it identifies a level of system 
performance that is acceptable in the circumstances. But it does serve as a 
general framework for guiding future decisions and moulding them in such a 
way as to increase their contribution to the objectives of the system. 

Thus, the standing plan serves as a benchmark for managing the 
subsequent stages of the planning process. It acts to reduce the number of 
viable program options which emerged during the second stage. It sets the 
stage for the programming of policies in two ways: (a) by pointing to 
strategies for implementation; and, (b) by identifying in a more concrete 
way the problems to be tackled, the resources available, and the allocations 
that will be required to implement the policy. And it can be used (in 
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conjunction with the feedback phases) to analyze, evaluate, and improve the 
planning system as a dynamic system rather than as an assembly of separate 
task forces and cases. 


Stage 4. After agreement has been reached on the policy options to be 
presented to decision makers, plans of action to put those policies into 
effect must be drawn up. This is at least a two-stage process. The first stage 
involves a careful examination of the capabilities of the implementing 
system to extract the resources necessary to see the plans through, to 
reallocate those resources when needed, to control its own behavior, and to 
secure the commitment of its members to the plans. 

The second requires the transformation of the general policies into 
specific programs or time-phased plans for assigning resources and for 
specifying the steps required to’work toward stated objectives. Effective 
programming demands that provision be made for the coordination of 
policy and programs, that the mix of program activities be balanced through 
careful analysis of social and political preferences for action, and that the 
sources of manpower to be used to carry through the planned programs be 
identified. 

When programming an educational policy, special attention should be 
given to (a) the provisions of coping with resistance to change, (b) the 
feasibility and consequences of integrating the planned programs into 
existing educational procedures, and (c) the need for defining and 
protecting the educational rights of the citizenry. 


Stage 5. To be effective, planning must be organized to support a 
continuing process and not merely the production of plans or occasional 
blue-prints. Thus, a planning system must have organizational equipment to 
handle the evaluation and redesign of planned programs and to adapt its 
procedures to environmental changes. Consequently, plans presented to 
decision makers should include specifications for monitoring and evaluative 
procedures as well as a description of mechanisms which might be used to 
receive feedback about the impact of programs once they are implemented. 

It is hard to overemphasize the importance of such an adaptive 
capability for the policy maker as well as for the planner. On the basis of 
present evidence, this capability plays a crucial, positive role in optimal 
planning by enabling planners to cope with uncertainties and to work out 
contradictions and correct weaknesses in standing plans. 


Stage 6. Although the findings of research and the development of 
theories are becoming increasingly important in the determination of public 
policy, the planner must still secure the support of political agenc:es for his 
program and rightly so! In this subtle area, the planner must judge the 
attractiveness of his work to pragmatic politicians and he must remember 
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that, when confronting major problems, he functions both as a formulator 
of options and as an advocate of one of a number of alternative courses of 
action (because he cannot possibly remain neutral to his own work). Other 
persons make the decisions about the actual program to be followed. 
Realizing that the success of the planner’s efforts are partly determined 
by the quality of policy making (and vice versa) also has other implications 
for the planning process. One is the importance of developing improved 
connections with the policy making system itself. Another is that the 
planning agency must handle political, qualitative issues openly, but 
cautiously. And, finally, planning and policy making should be thought of 
in relation to each other, both being essential parts of governmental action. 


Stage 7. Securing approval for an acceptable plan and seeing it through 
to implementation are two very different things; in fact, it is between these 
two stages that the planning process most often breaks down. The execution 
of the plan must be motivated, in the political sense of mustering support 
for the plan, in the administrative sense of pushing the plan forward through 
incentives and authoritative means, and in the psychological sense of 
overcoming resistance to change. 

The execution of the plan depends on designing and carrying out field 
activities. These processes not only make up the implementation phase, but 
are important to the planning process in two other ways: (1) replanning the 
initial program is carried out during this phase; and (2) the way in which 
the plan is executed determines its real substance. In other words, effective 
planning requires that plans be recycled and revised when they go off course 
during implementation and also that concrete indicators for measuring the 
progress of the plan and assessing its direction be developed. 

Finally, this phase involves reshaping the planning process itself. The 
planner continuously alters the context in which he works; as plans are 
implemented, the planner’s situation changes. Moreover, an evaluation of 
the differences between the realities of a plan and its intentions amounts to 
an evaluation of the planning process as well. In these two senses, then, the 
optimum model of planning requires systematic learning from feedback, 
extinguishing dysfunctional aspects of the process and reinforcing its 
strengths. 


A Note on Feedback. It should be apparent by now that the planning 
process cannot be reduced to the simplistic logic of a linear, perfectly 
rational, model of planning. There are important limitations on the 
planner’s knowledge of alternative courses of action, of the comparative 
costs and benefits of these alternatives, and of their consequences. The very 
nature of the political system in which the planner functions sets the limits 
of public action. 
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But these generalizations do not indicate that there is no rationality at 
all to the planning process. Rather, they point out the limits on rationality 
in planning which follow from the planner’s attempts to deal with issues by 
simplifying the dimensions of the problem and possible solutions to the 
point where they are manageable. 

Yet, if planners are to reduce problems to manageable proportions, it is 
likely that the actual results of their programs often will not be what was 
required. So the planner needs feedback about his efforts in order to revise 
programs, to make changes in the way in which the plan is being 
implemented, and to improve the future operation of the planning process 
itself. 

Feedback among the stages of the process prior to the execution of 
plans is as important as feedback between one cycle and the beginning of 
the next. Since optimal planning depends on constantly moving back and 
forth between what is and what is desired by relevant reference groups, all 
stages of the process must be cross cut and connected by rather elaborate 
and, ideally, efficient channels for communication and feedback. 


An Illustration. An illustration may help to clarify the stages of the 
model and the dynamics of the planning process. Suppose that policy 
makers are concerned about inequality of opportunity in higher education 
and that they direct pianners to explore the situation and make some 
recommendations. The planners start with some knowledge of the system’s 
post-secondary institutions, their programs, their present enrolment, and the 
basic characteristics of the student population. This initial knowledge is 
likely to be rather general and to need bolstering by more detail, both about 
the present state of affairs and about the likely shape of the future if 
present trends continue and if assumed changes in the trends do take place. 
When this information is obtained, the planner must determine whether the 
policy makers’ early concerns were justified, that is, whether the present 
performance of the system falls short of current social and political 
expectations. Assuming that a significant gap exists (if the gap is not 
significant, the planning cycle may be halted at this point), the planner 
continues his efforts with a preliminary, perhaps very general, definition of 
his task — to develop solutions for the problem of unequal opportunity — 
and with the identification of a wide range of possible options. 


Before he can formulate a tentative set of feasible alternative plans, 
however, he has a myriad of choices to make in order to reduce the problem 
to manageable size: he must examine the system closely and determine 
where to focus — is he to be concerned with all post-secondary institutions 
or, for example, only with universities? He must consider the constraints of 
the situation and establish, at least for the time being, the boundaries for his 
planning — the availability of financial resources, professional personnel, 
and space are usually the three most important and most difficult to come 
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to grips with. He must determine which factors are associated with 
inequality of opportunity and, by relating them to the relevant constraints, 
consider how he might intervene and which of the system parameters might 
be manipulated — entrance standards, upgrading of the secondary education 
of the deprived groups, financial assistance, special programs, and so on. He 
must assess the social costs and benefits of each alternative and rank the 
options. And, he must consider the problem in the light of other issues 
facing government, and weigh it in relation to other competing public 
priorities. 

In view of these decisions, he can proceed to the formulation of a 
policy or a range of policy options. From what is explicit or implicit in the 
definition of the planning task, the planner will have developed a set of 
evaluative criteria. When he has selected the options he will present to 
policy makers, he is ready to begin programming the policies in preparation 
for a decision on the options. 

When developing programmed, time-phased allocations of resources to 
plans and determining how to motivate the execution of plans (in all three 
senses referred to earlier) the planner is confronted by numerous questions: 
How much money will be required during the life of the plan and how much 
will be needed in each year? Is the present law as it relates to educational 
opportunity suitable, or will new legislation be necessary? What will be the 
significant sources of resistance to the various plans, and how might their 
resistance be overcome? 

In addition to programming the alternatives, the planner must consider 
how he will measure their performance. What criteria for evaluation should 
be developed? For example, are simple numerical changes in participation 
satisfactory measures or are some other indicators of participation rate 
required? What level of aggregation should be used — the whole system or 
specific institutions? What sources of feedback will he look for: minority 
groups who claim discrimination? hard-pressed registrars? taxpayers? When 
will he make his assessment — annually, or only at the end of a specified 
number of years? 

The next step, presenting options to public decision makers, is 
decidedly political in character. There are three possible outcomes. The first 
is that one option, or a combination of parts from different options, may be 
approved for execution and sent to public administrators. The second is that 
the policy makers may reject all of the options and ask the planner to 
develop others. The third is the most likely — the planner and the policy 
makers will work fairly closely together, recycling proposals and revising 
them until an adequate or acceptable plan emerges. This iteration usually 
involves a re-examination of constraints and can result in modifications to 
the system, to some resources, and to policy objectives. 

When a plan has been approved, the planner has one more set of tasks 
in the cycle — to assist in the implementation of the program, to plan for its 
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evaluation, and to ensure that necessary revisions are made. Thus, the last 
stage of one cycle overlaps with the first stage of the next, and the process 
continues, cycle after cycle, until some constraint puts a stop to it, or until 
the performance of the system reaches a point which is judged to be 
satisfactory. 


Conclusion 


This chapter has tried to capture the principal features of contemporary 
ideas about education planning and to describe as briefly as possible the 
elements and movement of an optimal planning process. In essence, the 
model represented the movement of planning as a function of constraints — 
financial, temporal, political, and intellectual. It described the planner’s task 
as working with these constraints — altering them, adding to them, or 
removing them — with the aid of the policy maker. It showed the planner 
pulling together ideas and information from a variety of sources — analysts, 
political groups, and forecasters — and tempering that information with his 
own intuitions and judgements. And, it emphasized the advisory character 
of the planner’s role — advice to policy makers about priorities for public 
action, about ways to intervene into the system to achieve these priorities, 
and about the evaluation of social progress. 

Planning as described in the model should make day-to-day problem 
solving congruent with concern for the future. Realities being what they are 
in educational systems, the way in which a planner behaves cannot be solely 
determined by what may be called ideal planning. Planning being what it 
should be, an attempt to do something about the future, the planner cannot 
be allowed to lose sight of the ideal because of day to day organizational 
routines. 


CHAPTER THREE 


THE INFLUENCE OF CIRCUMSTANCES AND IDEOLOGIES ON 
EDUCATION PLANNING 


Education planners (they are not, of course, alone in this) are 
commonly troubled by two occupational diseases. The first is administrative 
myopia; its symptoms include a fetish for detail, intolerance of the 
unexpected, and neglect of the human problems of planning. The other is an 
addiction to sloganism. Its symptoms are no less bothersome: lack of 
concer for the specifics of education, fuzzy thinking, and inability to offer 
guidance to those responsible for carrying out planned programs. Both 
diseases have the same effect — the most knotty questions about the 
organization of planning, those that have to do with people, are left 
unanswered. 

In theory, it can be deceptively simple to cure these afflictions or to 
immunize the planner against them, but the practical problems of creating 
close ties among goals, programs, and people often seem insurmountable. 

Perhaps the most pervasive problems to be encountered in the planning 
process arise from fear or distrust of planning, but there are other sources of 
difficulty. Both goals and standards of efficiency are by nature highly 
debatable, often impossible to translate into acceptable specifics. Organized 
interest groups are often powerful enough to oppose effectively planned 
programs. In short, planning leads to anti-planning (Ewing, 1969), and the 
contours of each confrontation are drawn by the people and institutions 
involved. 

The obviousness of these generalizations makes the longstanding neglect 
of them in the theory of planning surprising. Nevertheless, a fact remains: 
there is a need to understand the full range of individual and institutional 
forces that shape the organization of planning. The purpose here is to 
explore in a preliminary manner two general questions related to this central 
concern: (1) how do external social and political forces influence the 
organization of education planning? and (2) how do these conditions affect 
the outputs of the planning process? To deal with these questions, studies 
which describe the organization of education planning, the struggle over the 
control of education, the iterative character of planning, and the behavior of 
planning organizations will be reviewed. 

A useful point of departure in examining these studies is related to the 
concept of the “organization set” (Evan, 1966) or interorganizational 
network. The most salient features of a planning organization’s environment 
have to do with other public and private agencies which influence it. These 
other organizations, including teachers’ and school trustees’ associations, 
government branches of the public service at all levels, and educational 
institutions, are the remaining elements of the planning agency’s set. 

The set generally circumscribes the functions of the planning agency 
and has an impact on its structure, method of operating, and, of course, on 
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its relations with other actors in the planning process. The main features of 
the set (including, for example, its distribution of authority and functions, 
size, and degree of integration) can help to explain variations among 
planning organizations along such dimensions as their structure, their 
autonomy, their public identities and credibility, their effectiveness, their 
linkages with other public and private planning systems, and their relations 
with other organizations in the planning set. 


The Organization of Education Planning 


Planning is basically a socio-technical process related to the creation 
and implementation of policy. Its purpose is to assist policy makers in the 
design and selection of appropriate courses of action, in the programming 
and implementation of policies, and in the evaluation of existing policies. 

Although this statement is generally accepted among planners as a 
description of their tasks, the actual functions and positions of planners 
vary significantly. (Tinbergen, 1964; OECD, 1966; UNESCO, 1968). In his 
1963 survey of central economic planning, at one time the usual model for 
education planning, Tinbergen found that few countries had separate 
planning ministries or formal training programs for planners. Considerable 
agreement on the official task of the planning agency was apparent. Most 
agencies were responsible for the preparation of long- and short-term plans, 
for appraisal and advice on individual projects, for the coordination of 
activities in economic policy, and for supervising the execution of approved 
plans; only a few were expected to produce evidence for advisory bodies 
and to execute approved plans. There was similar unanimity on the 
functioning of the agencies: most were required to make forecasts and 
propose changes in economic policy, while only four were engaged in 
directive planning. The actors in the planning process and their respective 
roles varied greatly, even though there was substantial agreement on the 
main aims of economic planning. Finally, the planning techniques most 
commonly used were trial and error approaches and rather gross 
macro-economic models for policy analysis. 

In 1964, Canada’s Dominion Bureau of Statistics published the results 
of a background study of education planning practices in the provinces of 
Canada and in several Western nations. In general, this study showed that 
the structures, official tasks, and functions of education planning agencies, 
whether in school districts, universities, or departments of education, varied 
even more greatly than their economic counterparts, and that education 
planning relied heavily on statistical forecasting and trial and error 
techniques. 

A more recent UNESCO (1968) survey indicated that some 
improvements to the structures and methods of education planning had 
been made since 1964, but concurred with OECD reports (1966, 1967) that 
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much remained to be done. The most significant developments came in the 
area of securing the foothold of the planning function in the government of 
education. Among those concerns which continued to need much attention 
were the determination of educational aims and policies, the diagnosis of 
economic, social, and educational development, and the training of 
educational planners. 


The Location and Structure of Public Planning Agencies 


The operation of government requires a constant interplay among 
executive branches, planning agencies, and policy making bodies. The 
principal actors in the planning process are drawn from these groups and, 
because of their overlapping responsibilities, it can be difficult, in practice, 
to separate their functions and to say, for example, who is a planner and 
who is not, what is planning and what is not (Kahn, 1969; UNESCO, 1968). 

The hierarchical arrangement of agencies and persons formally engaged 
in planning varies with the nature of the planning task and with the number 
of outside bodies to be contacted in the preparation of plans. In most 
instances, whatever the agency’s official name, the planning body is 
attached to the Ministry of Education. In the better circumstances, 
educational planning agencies have achieved an “‘interdepartmental status” 
or direct access to other relevant departments of government. 

A great variety of tasks have been assigned to planning units — 
programming, implementation, research, forecasting, and so on. The usual 
practice is to arrange the unit around some of these tasks and, frequently, to 
place planning for different school levels (especially higher education) and 
for academic services and physical facilities in the hands of separate units. 
(UNESCO, 1968; DBS, 1964). 


The Roles of Actors in the Planning Process 


The basic role definition of an actor in the planning process is taken 
from the agency which he represents. Thus, in most cases, the power of 
approval or veto rests with elected representatives and the Cabinet as a 
whole, or ministers separately; all other bodies, including the planning 
agency, other government units, and special interest groups function in an 
advisory capacity, as sources of information, or as executors of an approved 
plan. 

In general, planning agencies act in one or a combination of the 
following ways: as creators of options for policy makers (Eide, 1969), as 
advocates of one of a number of alternative courses of action (Peattie, 
1968), or as managers of social change (Zaleski, 1967; Kamenister and 
Bilner, 1967). 
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There are marked differences from system to system in the ways in 
which the planning agency is expected to function. When making some 
comparisons, for example, between practices in Russia and the United 
States, (Bestuzhev-Lada, 1969; Rostow, 1959), many of the differences can 
be attributed quite readily to variations in political ideology. In other cases, 
however, variations cannot be accounted for so easily — the division of labor 
among the actors in the planning process is negotiated over time, and the 
results of the negotiations vary significantly from place to place. In 
Saskatchewan, for instance, the relative influence of the various actors 
involved in the management of education has shifted several times in the 
sixty-five year history of the province. Before the Saskatchewan Teachers’ 
Federation was established in 1935, the school trustees were the dominant 
extragovernmental force. By the late 1940’s the Teachers’ Federation had 
become dominant and retained that position to the middle 1960's. 
Recently, the influence of the Saskatchewan School Trustees’ Association 
has become pervasive once. again. The significance of such shifts on the 
process and products of planning and policy making in education is obvious. 

This brings us to a final point — the roles of the actors in the planning 
process have a dynamic element (Rose, 1962; Kahn, 1969). In most 
circumstances, the role relationship among the actors is a pragmatic, 
sometimes efficient division of labor and a reflection of the special interests 
and political capabilities of the actors. The division of labor is modified as 
the interests and capabilities of the actors change, and as public attitudes 
toward various approaches to political action change (Schlesinger, 1957; 
Hofstadter, 1965). 


Policy Makers, Planners and Pressure Groups 


One of the charter myths of the traditional approach to education 
planning has been that planning is supposed to be nonpolitical and to be 
kept out of partisan politics or political infighting among pressure groups. 
But the most important questions about planning, whether its purpose was 
to capture the future, set right the past, or do something in between, were 
and still are the subjects of continuing political controversy. What goals 
should be pursued? Who selects them? How will the goals be pursued and 
who will manage the process? These issues, and many others like them, have 
been and will continue to be resolved, although not always satisfactorily, in 
the political arena. 

In assessing this arena, the political tactics that are used, and the 
substance of many of the controversies, two themes merit most of the 
attention: the issue of multiple control over education and the cultural 
context of policy innovation. 
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Multiple Control Over Education 


The work of the education planning unit is dependent on a variety of 
public and private agencies. Some of these organizations exist only because 
their members have a stake in formal education (such as_ teachers’ 
associations), others because they have legal responsibility for aspects of the 
educational systems (for example, departments of education), and still 
others, such as private associations and churches, because they have an 
occasional or even a continuing interest in education. While this typology is 
a crude one, and other classification schemes could be developed (Campbell, 
Cunningham, and McPhee, 1965), it is nevertheless useful because it 
identifies and groups the wide range of associations that confront the 
planner and attempt to influence his activities and the educational system. 

A clearer understanding of the political world of the education planner 
also requires an appreciation of how political controls in fact are exercised. 
It is unfortunate that only a few studies have been made of the politics of 
education; but the findings of those which have been completed, when 
combined with the results of studies of community power structures, have 
provided empirical observations that will be valuable to future investigators. 
Those studies which have addressed themselves to this question (including 
Kimbrough, 1964; Bailey and others, 1962; Munger and others, 1961) 
collectively suggest the following major propositions: 

1. The patchwork character of education planning is a reflection of the 
multiple controls over the educational system and indifference to the 
planning function within the educational set, particularly on the part of 
government. 

2. The great number of organized groups with a stake in education and 
the ambiguities of their respective roles in the policy making and planning 
processes have led to the fragmentation of educational policy making 
structures. 

3. Planning capabilities, and the power resources which can _ be 
activated to influence the instigation, process, and outcomes of planning, 
are unevenly distributed among the elements of the planning set, and the 
balance within the set changes over time. 

4. In federal nations where jurisdiction over education rests with the 
region, regional policies are being increasingly influenced by national 
pressures, policies, and resources. 

5. Economic power appears to be the most significant single 
determinant of influence on the extra-legal aspects of the policy making and 
planning processes. Unfortunately, little or no attention has been given to 
tracing historical shifts of the importance of economic determinants in the 
two processes. 

6. The most frequently used methods of handling friction within the 
planning set include bargaining, compromise, avoidance of crucial issues, 
coalition building, and official governmental intervention. 
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The Cultural Context of Policy Innovation 


To cope successfully with contemporary educational policy issues, a 
political system must be able to promote reform and development by state 
action. In the current context, reform and development usually involve 
rationalizing the policy making process and authority structures, realigning 
channels of communication on public issues, changing traditional forms of 
behavior, and accommodating changes in the social goals and the emergence 
of new social forces. One of the most visible contemporary examples of the 
process of reform is the attempt to improve budget making in government 
by the introduction of the Planning-Programming-Budgeting System (PPBS). 
New budgetary procedures have far-reaching implications for any 
organization — who wields power, what information is significant, how 
priorities are set, and so on. And, clearly, reform cannot be accomplished 
instantly. The gains of any attempted reform, if there are any, will be 
realized only slowly, after a period of sometimes acute disequilibrium and 
when the substance of the reform has been supported by complementary 
changes in the people, structures, and process of government. 

But the possiblities for reform and for planning “depend not upon our 
choice among mythical grand alternatives (Dahl and Lindblom, 1953, p. 
6)”. Nor do they depend, in the first place, on technology or quantitative 
problem solving techniques. Rather, the evidence from international 
comparisons of planning practices suggests that the more basic question is 
“What political and cultural conditions are conducive to policy 
innovation?” According to Dahl and Lindblom (1953, p. 9), 


[t]he process of innovation is both scientific and political. It is not 
enough that new social techniques be discovered; they must also be 
put to use. Invention and discovery are only the beginning of a 
process the next step in which is innovation, a matter of politics. 


In short, unless due attention is given to political-social-cultural factors and 
to choices among particular social techniques, planned programs will remain 
only that: planned. 

F.G. Burke (1967) has identified the most important of these cultural 
inclinations: 

1. concepts of time, particularly as they influence the planning 
horizon, the “timetable” of development, and the scope of planned 
activities. 

2. the capacity to accommodate and guide social change and to plan 
social progress. 

3. the distribution of political power and authority, and 
consitutionalism. 

4. organizational structure and the capacity for invention and 
innovation in social structures. 
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5. technical range or the ability to call upon a variety of techniques for 
the solution of particular problems in the interests of more rational choice 
and a closer fit of means to ends. 

It is hard to say how much each of the five factors influences planning, 
for we can only make extremely crude estimates of their presence and 
effects. We can, for example, roughly state that one province has a greater 
capacity for organizational innovation than another, or that the planning 
horizon is generally longer in developed nations than in the developing 
states. Nevertheless, although this ambiguity leads to obvious research and 
development problems in planning education, these rough judgements can 
be satisfactory for most purposes. 

Further, these cultural variables taken alone, in combination, or in 
interaction with other factors (such as the availability of resources) 
generally define the limits of potential socio-political processes for goal 
setting, the calculation of policies and programs, and the control of standing 
plans. Of course, in a pluralistic setting, the congruence between general 
cultural norms and specific political action is far from perfect. Nor is the 
latter a mere reflection of the former. But they do influence each other over 
time. 

Three major political-economic processes — goal setting, calculation, 
and control — form the core of the planning process. The three are far too 
complex to be analyzed here. What follows is an extremely terse, very 
general summary of Dahl and Lindblom’s pioneering and stil! stimulating 
treatment (1953) of them. Most of it is in their own words. 

The things men value are countless. Yet a small number of key values 
are peculiarly relevant to an appraisal of alternative techniques for rational 
social action, planning, and economizing — freedom, rationality, democracy, 
subjective equality, security, progress, and appropriate inclusion of classes 
of people in the governmental processes. They are relevant because they are 
instrumental to a variety of other values, because they are highly ranked by 
many of us, and because they are the source of much of the controversy 
over the desirability of alternative political-economic techniques. 

Whenever scarce resources are significantly involved, these seven values 
can be maximized through certain basic social processes. It follows that the 
social processes are also valued as means. And, obviously, social processes 
that facilitate rational calculation and the scheduling of social action (such 
as science and Utopianism) are indispensable means to all seven ends, not 
merely to rationality. So too are the social processes that facilitate control; 
one must control others to remove obstacles to one’s own desires, and one 
must be controlled to remove obstacles to theirs. 

Calculation, control, and, therefore, planning are dependent upon four 
crucial social processes: the price system, control by leaders (hierarchy), 
control over leaders (polyarchy), and control among leaders (bargaining). 
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Because of this dependence, then, if one wishes to approximate the seven 
ends of social action, one must value these means of control, or at least 
certain ways of using these means. 


The Iterative Character of Education Planning 


The planner, as has been said, serves many goals and faces many 
pressure groups. The pressure groups cannot all be satisfied simultaneously 
and the pursuit of some goals can conflict with the pursuit of others. 
Moreover, both the goals and the balance of power among the pressure 
groups are in constant flux. 


Thus, even when planners operate with a specific mandate, they do not 
proceed, as the traditional account of “‘blueprint planning” would have it, in 
a simple linear way from their mandate to planning to implementation. This 
would of course be a tall order, even in a fully predictable world. And in an 
unpredictable world, which is, after all (and in spite of the desires of some 
who would plan), the kind of world we live in, an attempt to follow the 
linear model would be dysfunctional. 

The incomplete, iterative approach to planning, the so-called “science 
of muddling through,’ when it is properly understood and carefully 
monitored, can pay some dividends to planners. Because not all of the 
consequences of a particular course of action can be known ahead of time 
and because social goals are not always formulated carefully, iteration with 
revision enables the planner to improve his knowledge of the system, its 
human and financial resources, and its goals and policies. The recycling of 
programs through the planning process can encourage adjustments in 
Operating organizations. When mistakes are made, they can often be 
corrected readily. Timed compromises among conflicting goals can develop. 
Finally, although the iterative process is time-consuming, it helps to ensure 
that planned programs will be integrated and kept on course. 

There is another sense in which incomplete planning can usually be 
regarded as a more effective form of planning. Telling other people what to 
do and then getting them to do it (activating the plan) has always ranked 
among the most difficult arts of the planner. The reason for this is obvious — 
the behavior of people cannot be determined by tightly engineered sets 
of rules alone. Motivating the implementation of a plan requires mobilizing 
and maintaining a network of support and acceptance. The surest way of 
accomplishing this is to design a strategy for activation which appropriately 
mixes various forms of influence — command, persuasion, pressuring, 
manipulation, involvement, and self-determination. In short, incomplete 
planning at the top and introducing lower level personnel to planning, 
instead of myopic concentration on what Ewing (1969) has called the 
bloodless criteria of the planner (economic analysis and forecasts, 
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production capacity projections, and distribution functions), are general 
preconditions for organizing a successful planning process. 

Under certain conditions, however, the incrementalism implicit in 
iterative planning is not satisfactory. When, as Dahl and Lindblom have 
written (1953, p. 85), “scientific methods have not yet produced tested 
knowledge about the probable consequences of large incremental change, 
small changes will clearly not achieve desired goals, and existing reality is 
highly undesirable,” calculated risks are often necessary. It should be noted, 
however, that the consequences of both incrementalism and calculated risks 
are indeterminate at the outset but that, as plans are implemented, they 
become determinate, measurable, and subject to revision. 


How Planning Organizations Function: Notes Toward a Model! 


Although there are a large number of models which might be used as 
frameworks for analyzing the decision making processes in organizations, 
few represent adequately the behavior of public organizations. Most models 
concentrate too heavily on the internal operation of organizations and do 
not pay enough attention to extra-organizational factors influencing 
decision making. In short, because of the political nature of planning, any 
model of the behavior of planning agencies must represent adequately both 
the intra- and extra-organizational aspects of planning processes. 

What is needed, then, is a model which places a heavier emphasis on the 
political aspects of planning than does the optimal model of Chapter Two. 
The two models should complement each other. The first was a model for 
optimal planning; another model, to be used for description of the political 
side of planning, needs to be developed. The first was highly rationalized; 
the other model should view planning in human, political terms. 

Further, such a model should be built around three of the principal 
phases of the planning process described in Chapter Two: 

1. The instigation of planning and the initial reaction of planning 
bodies to demands. The old distinction between planning and political 
activity is not tenable: contemporary planning is too closely linked with 
policy, the identification of public priorities, and, hence, with politics. And, 
in reality, the operation of the planning agency seldom, if ever, conforms 
exactly to the procedures of formal organization; gaps between formally 
stated objectives and those aims which are actually pursued have to be 
resolved; conflicts of interest must be adjudicated, and priorities must be set 
and legitimized. 


IThere are a great many hypotheses embedded in the following discussion which 
must for the sake of brevity, be left implicit for the time being. The final section of 


this chapter, ‘““Some Basic Questions About the Organization of Planning,” will make 
many of them explicit. 
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2. The iterative, problem-oriented search for alternatives. Although 
planning is, ideally, a continuing process, and even though an increasing 
number of governments are establishing permanent planning agencies, 
planning has not yet become something which takes place automatically or 
as a matter of course. The planning agency functions in a socially and 
politically intricate web of organizations and responds to initiatives or 
actions taken by other members of the planning set (Soule, 1967); in some 
situations the planning function is even regarded as a political prize (Bor, 
1967). 

3. The process of ‘“‘organizational learning” or altering the character of 
the organization and its methods of operation to meet changing conditions. 
In general, planning agencies have not often been guided by an overriding 
sense of mission. Instead, various combinations of environmental and 
ideological processes have operated to initiate planning (Kimbrough, 1964; 
Munger and others, 1961) and to influence its purposes and products. But 
the impact of outside forces on the planning agency is highly variable 
(Litwak and Hylton, 1964; Evan, 1966), and much of the planning unit’s 
reaction is conditioned by the relative power of the instigating organization 
and by its own responsiveness to external conditions (Dill, 1958; Udy, 
1964). 

Unfortunately, few studies have directly examined the strategic 
responses of planning organizations to interorganizational constraints and 
ecological conditions (a notable exception is Wildavsky, 1964). By and 
large, to obtain the insights or models that are needed, we must turn to 
studies outside the field of planning itself. 

The work of Cyert and March (1963), with modification, provides a 
plausible framework for examining the planning process in terms of “the 
variables that affect organizational goals, the variables that affect 
organizational expectations, and the variables that affect organizational 
choice (p. 115).” These variables, and the small number of relational 
concepts which form the heart of their theory — the quasi-resolution of 
conflict, uncertainty avoidance, problemistic search, and organizational 
learning — are the conceptual underpinnings of the following approach to 
understanding the behavior of contemporary planning organizations, 
particularly at the provincial level. 

The following four sets of propositions offer a very general summary of 
the framework: 

1. Quasi-resolution of conflict. Contemporary education planning is 
iterative and multi-purpose in character. Because the planner of education is 
called upon to serve multiple goals, conflicts over the operating objectives of 
the agency are inevitable. These differences are only infrequently fully 
resolved. At best, planned programs are an incomplete series of steps toward 
some goals and are continuously recycled as shifts occur in the planning set, 
its resources, and its objectives. 
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2. Uncertainty avoidance. Contrary to the traditional, logical account 
of the planning process, which suggests an unswerving attention to a given 
objective, planning organizations avoid political risk taking and uncertainty, 
generally by short-run adaptations to feedback (such as immediate demand 
for siudent places) and by attempts at stabilizing their environment. 
Problems are dealt with as they arise, and solutions are approached 
incrementally. And, planning bodies seek to form coalitions with other 
Organizations in their set in an attempt to reach or maintain a stable 
situation. 

3. Problem-oriented search. Planning has usually been stimulated by 
rather specific problems, and aims at finding solutions to those problems. 
The search for a solution has been motivated by the desire to discover 
acceptable alternatives, not alternatives which might call for a marked 
departure from current ways of doing things. It usually has been grounded 
in simple-minded concepts of causality. And, of course, it has been 
politically and ideologically biased. 

4. Organizational learning. Organizations purposefully adjust their 
mode of operating as shifts occur in their environment. Existing goals are 
modified and even cast aside in favor of new ones. Planning bodies quickly 
learn which other organizations in their set are the most important, and 
adapt to alterations in the balance of power within the set. Finally, planning 
organizations modify their “‘search rules” — both the information sought 
and the alternatives that seem acceptable change as the agency moves from 
one task to another. 

According to this exceedingly condensed discussion of the framework 
for analyzing the behavior of planning bodies, planning activity is stimulated 
by uncertainty-causing feedback from relatively powerful members of the 
planning set. The members of the set — government, departments of 
education, organized interest groups, the planning body, and so on — have 
access to political resources (Dahl, 1963; Munger and others, 1961). If the 
members can activate the resources and muster significant support for their 
point of view, they can impel the planning organization to respond to their 
demands. 

However, the planning body does not respond to demands for planning 
activity automatically. Like any other organization, the planning body seeks 
stability and equilibrium by trying to control its environment (for example, 
by securing guaranteed support for its existence and by forming coalitions 
with other members of the set) and by responding to pressures in routine 
ways. In short, it attempts to buffer itself against external demands and 
political pressures. 

Only when it is clear that demands cannot be resisted does the agency 
intiate a new planning cycle. While the actual course of the planning cycle 
may approximate more or less closely the movement of the process as 
outlined in the optimal model, in organizational terms the cycle represents 
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an iterative search for a solution to the immediate problem which will meet 
the political requirements of the situation. Decisions on the need to plan 
and on which of the alternative policies and plans are to be implemented are 
made by political agencies in the hurly burly of political life, not in the neat 
world of rationalized planning. 

Finally, the framework suggests the process of organizational learning. 
As planning bodies experience success and failure with organizations in their 
environment, with methods for moving planning forward, and with planning 
techniques, they learn what is effective and what is not, and reinforce or 
even routinize those which are and eliminate those which are not. The 
resulting plan itself is something which government (the larger system of 
which the planning agency is a part) adapts to demands and supports from 
its environment and to forces for and against planning. 


Some Basic Questions About the Organization of Planning 


The primary value of the preceding discussion is not in the 
generalizations or hypotheses contained in it, but rather in the questions 
about the organization of education planning that follow from it. In the 
absence of a rigorous theory, the best that can be done is to ask the right 
questions. Answers to these questions will point the way to a theory and at 
the same time resolve some of the organizational issues that have concerned 
planners for a long time. Of course, not all of these questions will be 
significant in every situation, but the various categories and the questions 
within each identify the variables which have been found to be significant in 
case studies of planning practices and which must find their way into 
theories about the organization of planning. 


The questions are organized in the following manner: 


I. Social Framework: . Emergence of planning 

Social and political environment 

Economic environment 

. External political environment 

. General attitudes 

. The hierarchy of goals 

Interest Groups 

External influences 

. The institutional network 
Political parties 
The decision making process 

. The legality of plans and the rule of law 

. Antiplanning 


Il. Goal Formulation: 


III. Decision Making 


MUA POMEPMUOW> 


2Most of the following questions are drawn from Peter J. D. Wiles (1967) and 
Bertram Gross (1964). 
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IV. Implementation A. Activators and sanctions 

Obstacles and limitations to implementation 
Correcting mechanisms 

. Goal achievement 

. Side effects 

Evaluation in terms of values 


V. Results 


Op POD 


Emergence of Planning 


In general what conditions have led to the emergence of education 
planning? Specifically: 

1. Who were the promoters and the adherents of planning? Has 
planning led to anti-planning? 

2. Has the perception of imminent crisis, or of accummulated 
grievances, been a factor in the emergence of planning or the cause of 
inaction? What kind of crisis has been perceived? 

3. To what extent have the emergence of planning and the selection of 
its type been dependent on political circumstances, cultural values, social 
ideologies, and technical and managerial abilities? 

4. What attempts have been made to adapt transplanted concepts, 
methods, and doctrines to local needs? 

5. To what extent, and why, have planning concepts, methods, and 
doctrines been borrowed by one province from another? 

6. Has education planning simply failed to arise at all, because of 
hopeless goal conflict, anti-planning ideologies, general satisfaction with the 
existing state of affairs, or lack of personnel resources? 

7. In terms of a formal typology (for example, manpower, rate of 
return, or social demand approaches), how can the planning system best be 
described? 


Social and Political Environment 


1. What are the main social divisions (class, ethnic, religious, and so on) 
which most affect the process of planning? 

2. What are the major interest groups, organized and unorganized, in 
the society? What values can be identified with them? 

3. What features of planning can be traced to ideologies such as 
socialism, Jaissez faire, nationalism, and conservatism? 

4. To what extent is the system subject to external pressures? 

5. To what extent does the need for assistance or the desire to resist 
external pressures lead to coalitions (for example, interprovincial 
cooperation through the Council of Ministers of Education) to improve the 
provinces’ bargaining position at the federal level? 
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6. How do the size and diversity of the province affect planning? Does 
the existence of cultural and national minorities in distinct areas affect 
planning? Do the geographical dimensions of the province, the density of 
the population, and the number of local or regional units of administration 
affect the planning process? 

7. Does the country’s federal constitution affect planning? 


Economic Environment 


1. How have existing economic structures affected planning? More’ 
specifically: 
a. how big is the public sector, and in what areas does it operate 
(including education, medicine, and social development)? 
b. how much of it is run by government departments, public 
corporations, and local authorities? 
what is the extent of the subsistence sector? 
. how extensive are the social services? 
how are employees organized? 
. What has been the performance of the economy with respect to: 
average net provincial income per capita? 
. retail and wholesale prices? 
percentage of net provincial income spent on education, other public 
services, net investment, and other consumption? 
What have been the trends in: 
a. the movement of population over time because of births, deaths, 
immigration, and emigration? 
. the residential breakdown of population? 
the breakdown of the population by occupations and skills? 
. the distribution of income between rich and poor? 
the variation of average income between areas, and among racial and 
religious groups? 


Ww esPNeadc 


© Gf. O5e 


External Political Environment 


1. Does interprovincial or national planning exist? If so, how did it 
arise? 

2. What effect has it had on planning within the province? Have 
provincial practices influenced interprovincial or national efforts? 

3. To what extent do provincial planning goals depend on national 
planning or action? 

4. Has national planning tended to disrupt federal-provincial relations? 

5. To what extent are provincial plans drawn up with a view to 
appealing for federal aid? 

6. Is planning influenced by the province’s desire to compete with 
others, for example, for federal funds or educational prestige? 
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General Attitudes 


1. How much do people want political objectives such as price 
stability, distributive justice, rational regional distribution of population, 
rational use of physical environment, health care, economic growth, a better 
balance between private and collective consumption, population control, 
educational opportunity, and racial or minority group integration? 

2. How much are people influenced by objectives such as religious 
freedom, high consumption, educational attainment, economic freedom, 
leisure, security, and health? 

3. What are people’s general attitudes toward government plans and 
planning? 


The Hierarchy of Goals 


1. What are the society’s overriding goals, and how are lesser goals 
subordinated to them? 
2. To what extend do personal attitudes and objectives conflict with 
provincial objectives? Do the plans recognize or conciliate this conflict? 
3. To what extent do planners seek to further educational equity? How 
is equity defined? 
4. Are planners restricted in the pursuit of other goals by 
considerations of social discrimination? For example: 
a. do they try to facilitate the social mobility of backward groups by 
investment in their areas, or do they maintain the status quo? 
b. do they try to facilitate or prevent the geographical mobility of 
underprivileged groups? 
c. do they try to assimilate minority groups by investing in their areas, 
by encouraging immigration into them, and so on? 
5. Do current ideologies inspire or inhibit the formulation of 
operational definitions of goals? 
6. To what extent are there implicit, informal, hidden, or latent goals 
underlying the more explicit, formal, open, and manifest goals? 
7. Precisely what groups, organized and unorganized, pursue which 
goals? 
8. What issues have led to major actual conflicts — budgetary freedom, 
religious rights, racial freedom, regional autonomy, investment versus 
consumption, quality versus quantity? 


Interest Groups 


1. Has education planning been consistent with the pluralism of needs 
and goals among different people and different sub-systems? 
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2. What identifiable interest groups exist? To what degree have their 
aims been articulated? 

3. Are these interest groups directly involved in the planning process? 
How do they get access to it? 

4. Do government bodies outside the immediate planning structure (for 
example, other ministries, local authorities) form interest groups with a 
serious impact on education planning? 

5. What notice do the planners take of the goals and interests of the 
broader publics? 


External Influences 


1. Are specific projects determined by the availabilty of federal capital, 
thus influencing the structure of the plan? 

2. Does the desire to attract more federal capital affect the politics of 
the plan? 

3. What are the problems posed for planners by federal capital 
commitments already made to the province? 


The Institutional Network 


1. Is there an identifiable central planning complex wholly within, 
partly within, or wholly outside, the government? If so, what is the 
relationship between such a complex and the government as a whole? The 
planning complex may consist, among others, of political leaders, 
representatives of financial and other special interests, professional experts, 
mediating personnel, and persons playing special roles created for dealing 
with issues of the moment. 

2. Are the professional and mediating personnel above civil servants? 
How secure is their tenure? 

3. What are the formal positions (for example, ministry, 
interministerial committee) of the planning bodies? 

4. What are the attitudes of the traditional departments of government 
toward planning and the planners? 

5. What is the position of local government in relation to provincial 
planning? 

6. How, if at all,do such pressure groups as those following influence 
the process of decision making: trade unions, professional organizations, 
youth and women’s organizations, church and other religious organizations, 
and private business associations? 

7. Are there any institutional provisions for consulting pressure groups 
during the decision-making process? At what stages of the process is the role 
of pressure groups most conspicuous? 
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8. What are the informal ways of exerting pressure on planning 
agencies? 

9. Which groups are most successful in making the pressure effective? 

10. On what factors does effectiveness of pressure most depend? 


Political Parties 


1. Have political parties the right to participate in drawing up the plan? 
Do they actually participate? What interests do they represent, and to what 
extent do they act as direct agents of particular interest groups? 

2. Is planning “‘nonpolitical,” “bipartisan,” or “above party,” and to 
what extent? If so, is it because the parties lack interest, because they agree, 
or because they have achieved a permanent or satisfactory division of power 
inside the planning apparatus? If not, do the planners simply obey the party 
in power? 

3. To what extent can planners resist political demands on “technical” 
or other grounds? 

4. To what extent do the planners influence party action? Can they be 
active party members? 

5. What is the role of campaign speeches, party platforms, and party 
programs in planning? 


The Decision-Making Process 


1. What are the devices used to recognize and handle friction among 
various publics and institutions? How efficient are they? 

2. How are contlicts handled in the planning process — through 
bargaining, compromise, insistence on victory or defeat, tolerance of 
prolonged deadlock, avoidance of crucial issues, coalition building, or 
interest integration in the process of goal formulation? 

3. Are there significant differences in goals and methods among 
members of the planning set? 

4. How and when do the planners use the following methods to effect 
coordination and overcome resistance among other bodies: settling disputes 
by giving orders, asking the groups involved to settle disputes among 
themselves, deliberately promoting competition among them, creating new 
institutions? 

5. What are the particular forms of resistance and dispute? 

6. Who are the key participants in the decision making process? What 
are their personal motivations and goals? With what interests, roles, and 
values can they be identified? What are their bases of political support? How 
frequently do they shift from one issue and role to another? 

7. What are the forms of participation by nonplanners? What aspects of 
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the decision process are conducted in the open and what aspects are 
conducted in secret? 

8. To what extent is decision making routinized? 

9. To what extent does the lack of trained people in relevant 

institutions limit the rationality of the system? 
10. What is the role of economists and social scientists in improving the 
rationality of decision making? 

a. How accurate is the economic, sociological, and other information 
used by the planners? How accurate do planners think it is? 

b. What mathematical models do the planners construct? What degree 
of accuracy would their underlying data require for the models to be 
useful? To what practical uses are the models in fact put? 

c. What deliberate biases are built into the information by the original 
sources? 

d. What role is given to social scientists other than economists in the 
planning society? 

e. To what extent are the planners’ attention and goals determined by 
the availability of data? 


The Legality of Plans and the Rule of Law 


1. What is the legal status of plans? 

2. Can nonfulfillment be penalized? How? 

3. What is the balance between status and delegated powers? In either 
case, is the plan subject to judicial review, administrative review, or review 
by the legislature or any other public body? 

4. Is the factual material on which the plan is based accessible to the 
public? 

5. To what extent are planning negotiations public? 

6. Has the constitution, or any legislation, been altered for the sake of 
the plan? 


Anti-planning 


1. How strong is political opposition to the broad lines of the plan, 
details in the plan, or the very existence of the planning authorities? 

2. How difficult is simple revision by those subject to control by the 
plan? 

3. Has the number of controls tended to decrease or increase? If the 
latter, was it in order to stop evasion of those already imposed, by 
Parkinson’s law, or for other reasons, such as increasing complexity of the 
educational system and increasing efficiency of communications? 

4. What is the balance between persuasion and pressure types of 
control? 
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5. Has increased planning gone hand in hand with a diminution of 
freedoms? 


Activators and Sanctions 


1. What activators do the planners use on outside agents: market 
(subsidies, direct taxes), persuasion (informing, providing an example, 
proposing, propaganda, advertising, logical argument), or pressure 
(bargaining other than in market terms, manipulation, legal command, legal 
prohibition)? 

2. What campaign strategies have the planners used — crisis 
exploitation, crisis creation, maintaining an optimistic stance, planner’s 
tension? 

3. If activation fails or threatens to fail, what sanctions are available to 
the planners? 

4. How do planners time their major decisions? 


Obstacles and Limitations to Implementation 


1. To what extent are the planners hindered by lack of social and fiscal 
discipline, sabotage, wholesale plan evasion, opposition to planning in 
principle, material self-contradictions in the plan, their own incompetence, 
and lack of money or personnel for their own functions? 

2. What are they doing about it? 


Correcting Mechanisms 


1. How quick is feedback? Are long-range goals broken down into 
sequential steps on which current information is possible? Are detailed plans 
worked out at shorter intervals than overall plans? Are short-term reports 
required? Are they made on a routine basis or by personal contact? Are 
periodic reviews carried out on regional or local scale? 

2. How rigid is the plan? At what intervals is it in fact altered? 

3. Are these alterations made a priori or as the result of feedback? 

4. Is the plan so flexible, owing to feedback, as to be epiphenomenal? 

5. What initiative, in implementation as opposed to formulation, does 
the system leave to lower levels? What are the differences here between 
formal and informal intiative? 


Goal Achievement 


1. Were the plans fulfilled? The originally published plans? Amended 
versions? How recent and severe were the amendments? 
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2. Whatever the results, would fewer direct interventions have been 
better in terms of the planners’ own broader intentions? 

3. Could different plans have better fulfilled the planners’ broad 
intentions? 

4. Would different types of planning have better fulfilled the planners’ 
broad intentions? 


Side Effects 


1. Apart from the province’s attempt to fulfill the plan, what side 
effects had the plan? Were these side effects anticipated by the planners? 
Were they part of their goals? 

2. How do the side effects look in terms of the planners’ own broader 
intentions? 


Evaluation in Terms of Values 


. Were the plan’s intentions good or bad? 
. Were its results, including the unintended ones, good or bad? 
. Would the plan have been better if it were less directive? 
4. Would different plans or policies have been better? Would different 
types of planning have been better? 


DW No 
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INFORMATION SYSTEMS FOR EDUCATION PLANNING 


Planning in education is essentially directed toward inducing change in 
the behavior of individuals, groups, or organizations. Because of the 
complexity and demands of the task, it is understandable that most of the 
efforts of early education planners were caught up in the anxiety-provoking 
rush of activity to develop, organize, and deliver services. But some critical 
questions about planned activities — “How good are they?” and “Good for 
whom?” — were lost in the shuffle. 

Now, however, such problems are becoming increasingly urgent. The 
planner is confronted by questions on all sides, from social scientists who 
wonder about the validity of social programs, from politicians who must 
balance expenditures on education with appropriations to other public 
services, from the media, who are usually quick to point to defects in 
standing plans, and from educators opposed to new ways of doing things. In 
short, the planner is being forced to evaluate his work and to justify 
continued support for educational programs. 

There are other reasons, as compelling as political pressure, for this 
renewed interest in the evaluation of educational systems, and, when these 
arguments are taken together, they make a convincing case for the 
importance of strengthening the evaluative aspects of the planning process. 
The planner’s objectives are value-laden and form a basis for rating the 
relative importance of various needs and demands. Implicit in any action 
program is the judgement that the present state of affairs is not good 
enough. Current policies and institutional procedures can be corrected only 
after they have been assessed. And there can be little doubt that sound 
evaluation is central to understanding the operation of the system and the 
direction and control of social change. 

In such a context, then, the problem of improving planning practices is 
fundamentally tied to enhancing the planner’s objective information about 
the educational system and its environment as well as his appreciation of 
goals and values, assuming, of course, that good planning usually requires 
good information — information that is valid, readily acccessible, timely, 
and reliable. 

This approach has far-reaching implications for the design of planning 
information systems. It means, above all, that the approach to information 
systems which dominates current practices, the computerization of routine 
housekeeping tasks (these will be discussed in a following section), is not 
satisfactory. Instead, different conceptions are required so that it will 
become increasingly possible to devise a system that will (1) meet the 
requirements of day-to-day operations; (2) facilitate the identification of 
educational problems and goals for educational innovations; (3) provide 
information for the control and evaluation of programs; and (4) enhance 
the exchange of information among planners and policy makers. 
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In view of the slow evolution of planning information systems to date 
(practice lags far behind theory), it is unlikely that a system which might 
meet all of these requirements can be made operational in the near future. 
Nor is any blueprint yet available that outlines how such a system is to be 
achieved. So, one is led to the questions, ““How can the operation of present 
systems be improved?” and “What further developments could contribute 
the most to education planning?” 


Toward Redesign of the Education Planning Information Systems 
Current Practices 


In Canada and, I suspect, in many parts of the U.S.A. and Europe as 
well, the information systems presently used in education planning are 
characterized by the conceptual poverty and technological affluence of 
computerized routine housekeeping applications. These applications, largely 
dedicated to the internal operations of government, are the product of a 
rather direct conversion from manual to automatic methods of handling 
data. Efficiency is the basic goal: the speed, accuracy, and economy of 
automatic procedures for sorting, counting, and carrying out simple 
mathematical operations are emphasized. Applications are limited to 
specific tasks and developed independently, and, consequently, cannot be 
combined with other applications to serve a variety of information needs. 

Whitlock (1964) provides a typical list of the various applications in 
school districts. 


Miscellaneous Business Accounting Student Accounting 
Library Accounts Payable Attendance Accounting 
Personnel Budget Grade Reporting 
School Directory Cafeteria Census 
Statistics Cost Analysis Permanent Records 
Testing Equipment Registration 

Inventory Scheduling 

Payroll 

Purchasing 

Retirement 

Transportation 


The same author has developed a rather exhaustive list of possible 
housekeeping applications at the provincial level: 
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Employee Personnel _ Pupil Personnel 


Certification 
Teacher approval 
Teacher employment 


School census 
Pupil enrolment and 
attendance 


studies Pupil dropouts 
Retirement records Socio-economic data 
Supply and demand on pupils 

studies Census of pupils 


Salary Studies 
Teacher-load studies 


enrolled in special 
education programs 


Miscellaneous Pupil retardation and 
statistics acceleration 
Preparation of Standardized test 
personnel scoring 
directory Standardized test score 


analysis 


Curriculum & Program 


Study School Facilities 


Data on school sites 
Data on school 


School accreditation 
Analyses on course 
offerings in terms buildings 
of pupils enrolled Data on equipment 


School Finance 


Provincial agency budget 
preparation 

Provincial aid distribution 

Internal payroll and accounting 

Cost analysis 

Fee accounting 

Recording expenditures and 
receipts of local school 
systems 

Reconciliation of local receipts 
reported with 
disbursements 

Local finance studies 


Specialized Services 


Food services 

Health services 

Pupil transportation 
records 


Studies of high school Analyses of classroom Vocational rehabilitation 
graduates shortages 


Although such applications are of basic importance, limiting 
information processing to these areas seriously underrates the significance of 
information about the educational system’s environment. The education 
planner stands at the centre of many systems — legal, political, and 
economic as well as his own — which touch every aspect of his work. One 
way to illustrate the significance of information about all aspects of the 
education system’s environment is to ask the question, “Education for 
what?” If part of the answer treats education as a means — to social 
opportunity, to social mobility, to employment or even to the “good 
life’? — then surely these other ends, which are essentially contextual, must 
be taken into account in education planning. When information about these 
systems and their effects on educational programs is not known or not 
available, it is impossible to get an accurate picture of educational 
operations, limited by constraints and pressures, creating products which 
may or may not meet expectations. Thus, even though developmental work 
is still required to strengthen most housekeeping applications, it is becoming 
increasingly important to give higher priority to reconceptualizing the 
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information systems used by education planners. The remainder of this 
section highlights the basic dimensions of this task. 


Studying the Information Needs and Uses of Education Planners 


In one sense, the education planning process can be thought of as a 
system for the collection, organization, management, analysis, and retrieval 
of information for decision making. Education planning is thus a way of 
reacting to the significance of information about the educational system and 
its environment. 

While such a view of planning is incomplete and connotes too much 
emphasis on the so-called “bloodless criteria’’ of planning (Ewing, 1969), it 
does highlight the crucial importance for planners and policy makers of the 
flow and content of information. But to this time, the problem of 
information processing in planning systems has received only very general, 
speculative, or cavalier treatment. One searches almost in vain for 
conceptually or empirically sound treatments of the complex forces which 
affect the flow in information. In large part, this is the result of a lack of 
systematic attention to: 

1. The full range of information sources that is available. In education 
data are collected at all levels. Only a small part finds its way to the 
planner’s information service, and information which is available to the 
planner comes under the general heading of “bread and butter” data, 
namely, data necessary for calculating financial grants to educational 
authorities or for the compilation of student scores on province-wide 
examinations. Most other kinds of information are treated as by-products of 
these data or as luxuries which the planning agency would like to afford but 
cannot. 

2. The nature, quality, quantity, and recentness of available 
information. Generally speaking, information of the housekeeping variety is 
kept up-to-date and accurate. Unfortunately, the same cannot be said for 
other kinds of information. Data on other governmental programs, even 
though they might require adjustments in the education planner’s activities, are 
generally not available to him. Information about the environment of the 
educational system is often exceedingly impressionistic and usually 
out-of-date. And so on. 

3. The uses to which the information will be put. The planning 
function, because of its political character and necessary reliance on the 
practiced judgement of planners, requires that information be treated in 
special ways. So, for example, experience has taught planners not to believe 
implicitly projections into the future. The statistician’s disclaimer, “‘all other 
things being equal,” seldom holds; in fact, one of the hardest lessons learned 
by planners in the last twenty years is that other things do not remain the 
same. 
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4. The characteristics of the user, including his background, 
motivation, professional orientation, and capacity for handling information. 
Even today, planners tend to be inadequately trained, either because they 
have no training at all or because they are trained too narrowly. How then, 
except intuitively, is the planner to cope with the diverse information which 
is sent to him and to make effective use of it? 

5. The systems — social, political, economic, psychological, and 
educational — that affect the planner and his work. 

6. The outcomes of information use, such as improvements in policy 
making, planning, and public administration. In some respects, this issue is 
the most difficult of the six to resolve, for here the problem of relating 
social research and social policy becomes clearer. The problem has two 
sides. On the one hand, politicians and social scientists seem almost unable 
to communicate effectively with each other. On the other hand, social 
science has not yet fully proven its usefulness to the policymaker. Indeed, in 
certain circumstances the practiced judgement of experienced policy makers 
can often result in better decisions than if the sole criteria for decisions were 
qualitative analyses. 

The six factors point to the major aspects of the dual problem of 
meeting the planner’s information requirements and doing so rationally. On 
the one hand, a wide range of data about relevant physical, social, political, 
and economic features of the environment needs to be combined with data 
generated in the day-to-day operations of the education system, if an 
information system is to be designed as an organized part of both the 
administrative, monitoring functions of government and its long term policy 
evaluation and planning activities. At the same time, the flow of data and 
information must be made manageable, by setting the boundaries for the 
design of the combined system, and rational, by establishing some criteria 
(such as econometric models and social indicators) for the exclusion or 
inclusion of data. The next section describes some basic approaches to 
grappling with these problems. 


Some Basic Alternatives for the Design of Planning Information Systems! 


Determining the general information needs of education planners is 
only a beginning, although a very difficult one. Many fundamental problems 
concerning the design of information systems are encountered at the more 
specific level of translating general statements of need into operational 
terms, and making trade-offs dictated by considerations of cost, personnel, 
system performance, and expected benefits. 

1in 1969 I studied the use of information processing technology in a number of 
Departments of Education, universities, and school systems in Canada and in a small 
number of research centers in the U.S.A. The generalizations contained in this section 


are based on the findings of that study. Kraemer’s article (1969) was particularly useful 
in providing guidelines for organizing the findings. 
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In a theoretical sense, the number of discrete design alternatives is very 
large, for the functions2, elements*, utilization variables+, and source 
variables?, of an Pe ioeion system can be put together in an almost 
unlimited variety of ways. But, for practical purposes, the number is much 
smaller. Indeed, the alternatives can be reduced to four broadly defined 
approaches — housekeeping applications, data bank services, modelling 
systems, and continuous process control — which can be adopted singly or 
combined in a hybrid design. Because housekeeping applications have been 
described earlier in this section, only the last three approaches will be 
discussed briefly here. Modelling systems will be covered more extensively 
in Chapter Five; the discussion of continuous process control applications 
serves as an introduction to our treatment of educational indicators later in 
this chapter. Of the four, the only approach adopted widely in education 
has been the housekeeping system. In outlining the other three approaches I 
have had to rely heavily on the experiences of other parts of the public 
sector, particularly in urban and national governments. 


Data bank services. The concept of the data bank approach to 
information handling grew as a response to the shortcomings of 
housekeeping applications. Those who advocated the data bank as a better 
alternative argued that planners require information about both the internal 
operations of the educational system and its social and economic 
environment, and that much of the data generated by other government 
agencies and private organizations could be used for education planning and 
management. It followed that the planner’s data base should be thoughtof 
more broadly and that the opportunity to eliminate redundant applications 
should be taken. A data pool could be conceived on a government-wide 
basis and, once established, could be made available for a wide variety of 
planning activities. So, the planner’s information system envisaged was “a 
massive data retrieval file, updated by operating agencies, continuously on 
call to its users, supplying them on a routine basis with the information they 
required (Kraemer, 1969, p. 390).” 


2The functions of an information system include data acquisition, cataloguing, 
abstracting, and indexing data, storage, retrieval, and dissemination of documents, 
association or correlation of variables, and data search. 


3.n information system has five debby elements: sources, messages, codes and 
contents, destinations, and channels. 


4Utilization variables comprise the host of economic, social, psychological, 
political, and technical factors influencing the processing of information. More 
specifically, this category includes variables such as the time requirements of decision 
makers, the quantity of information required, methods of presenting information to 
decision makers, and so on. 


Source variables are similar to utilization variables. Their significance is obvious: 
in large measure, they determine what information will be included in or excluded 
from the system. 
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But, generally speaking, data banks have not met these expectations 
and, consequently, they have not been used by planners. This is the 
outcome of three related weaknesses. In the first place, not enough 
attention has been given to defining the data base of these systems. Instead 
of developing criteria for excluding or including data which were a 
reflection of information requirements for organizational operations and 
planning, data were stored simply because they were available, or because 
people felt they needed them. As a result, the retrievable data have not been 
particularly well suited either to managing day-to-day operations or to 
planning. 

Second, the American experiences, particularly with urban data banks, 
suggest that participating agencies (depositors, in banking terms) are 
reluctant to cooperate fully with the central organization. Most of the 
problems encountered in such a situation are obvious: it has been difficult, 
if not impossible, to ensure that data files are updated regularly; general 
guidelines concerning data quality notwithstanding, the quality of data in 
banks tends to be uneven. 

Finally, because the data base of such systems has been difficult to 
define properly and because continuous updating has proven to be little 
more than a pious hope, the data pooled in these systems have tended to 
present a somewhat static picture with only short-lived usefulness for the 
agencies they were intended to serve. 

Briefly, then, although a number of attempts have been made 
throughout North America to establish data banks, a great many forces have 
operated in most cases to nullify these intentions. Instead of a data bank, 
the most common end result has been a centralized housekeeping system 
which remains inadequate for purposes of planning. 


Modelling systems. A quite different development has been the use of 
mathematical and logical models to represent the observable relations 
among significant variables in the educational system. Proponents of the 
model building approach to information processing contend that it is 
uniquely suited to handling specific problems, since (1) the parameters 
necessary for making educational forecasts can be estimated; (2) the 
implications of alternative educational policies can be assessed;(3) probable 
changes in the system over time can be determined; and (4) the 
development of a model is a useful way of evaluating the educational 
system’s data base. 

Again, however, the weaknesses of work in this area to date have 
significantly reduced its actual contributions to education planning. Almost 
all reasons given for the failure of such experiments can be traced to a single 
source: models have been developed “for functional specialists, by 
specialists, and with the specialists’ rationality (Kraemer, 1969, p. 391).” 
and are not often as compatible as they should be with the requirements of 
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policy making. By the time data have been assembled in a form suitable for 
use in a modelling system it is often, at least in education, two or more 
years old. Few models have been directed toward improving the internal 
efficiency of educational systems. Although most enable the planner to 
predict the likely consequences of various alternative policies, few, if any, 
provide him with any guidance in evaluating the alternatives. Because of 
their specialized focus, they have been developed independently of other 
information processing applications and without a view to general use by a 
number of agencies. And, either because of a poorly developed data base or 
as a result of weak methodology, the models themselves have not often 
provided adequate representation of real systems. 

Yet, in spite of these commonplace shortcomings of modelling systems, 
very promising work is going forward in the development of models of 
educational systems. The Simulation Option Model (SOM) currently being 
developed by the Organization for Economic Cooperation and Development, 
while not entirely free of the above-mentioned deficiencies, is among the 
best models now available. A recent application of SOM (Center for 
Educational Research and Innovation, 1970) in England and Wales 
illustrates the model’s potential. The study had two purposes: (1) to 
determine the probable effects of a change in the school leaving age from 15 
to 16 years, and (2) to suggest a timetable for introducing the change. 
Although the model was gross (it did not, for example, distinguish between 
types of secondary schooling) and the best available data were two years old 
(the base year was 1966-67, the most recent year for which sufficient data 
were on hand) the output did permit a tentative evaluation of policy 
alternatives, using a variety of assumptions about the rate of change. Output 
for each year included the following data: (1) pupil stock by level and unit; 
(2) teacher requirements; (3) teaching area needs; (4) required investment; 
and (5) capital costs. 

Clearly, results obtained from such a model cannot be used as the sole 
criterion for choice. The model is too gross and leaves too many important 
questions unanswered. But, as work moves forward in this area and as 
models are refined, such models may become valuable planning aids 
provided that appropriate adjustments to the information systems — 
ensuring that data are kept up to data, accessible, and suitable for use in the 
model and for policy making purposes. 


Continuous process contol. Education planners are becoming 
increasingly attracted by the tantalizing potential of information technology 
for the continuous, real-time control of planned programs, that is, for 
controlling processes as they happen in the present instead of on the basis of 
what has happened in the past. Impressed by military and business 
successes, education planners are beginning to look for a process control 
system that will enable them to monitor existing programs, to identify 
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required changes, and to expediate modifications to current operations. 

Some process control techniques, such as PERT (Program and 
Evaluation Review Technique) and CPM (Critical Path Method) have already 
proven their worth as basic tools of the education planners, both for 
identifying important stages in the development of educational programs 
and for monitoring the movement of planned activities. 

Yet the possible applications of process control technology extend far 
beyond these uses — to the potential development of educational indicators. 
To gain a sense of the likely usefulness of indices in education, consider for 
a moment this country’s continuing efforts to oversee economic policies and 
performance by means of wholesale and retail price indices, seasonally 
adjusted unemployment rates, quarterly trade estimates, and so on. These 
measures have contributed much to economic policy evaluation and 
planning, and, just as important, to communicating the state of the 
economy to concerned citizens. While similar information has not been used 
often in education, its potential is tremendous, especially for the 
development of better measures of educational opportunity, attainment, 
productivity, and costs. 


Making Information Systems Work: Some General Guidelines 


Changing information technology alone will not lead to any significant 
improvements in the policy making and planning systems. If information 
technology is to achieve its potential, a number of other conditions must be 
satisfied. | 

First, the data base and processing capabilities of the information 
system should be developed to the point that information should be 
available in a form that is conducive to being actually used in planning. In 
the first place, this requirement suggests that the information system be 
open enough both to reflect the clearly defined operations and planning 
needs of the educational system and to permit additions or deletions to the 
data base as needs change. In the second, it implies that information should 
be simply communicated, easily accessible, and readily understood by 
planners and policy makers. 

Secondly, changes in information processing should be reinforced by 
supporting changes in planning structures and processes. The points of 
information generation, analysis, and communication are key centers in the 
management of any organization and the focal points of the planning 
agency’s capacity to bring about change. It follows that realigning old 
organizational structures is a central concern in information system redesign 
and suggests that the closer integration of information technology with the 
planning process will have far-reaching implications for such traditional 
concepts of organization behavior as “unity of command,” “hierarchical 
communication,” and “red tape.” 
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A third consideration, analogous to the second, is that information 
system changes aimed at rationalizing policy making and planning in 
education are difficult to accomplish if the ethos of agencies in the planning 
set is characterized by an anti-planning bias or a strong commitment to 
“common sense” approaches to solving educational problems. These 
attitudes cannot be changed suddenly; a long, sustained effort to recruit 
better planners and policy makers and to design more appropriate 
institutional arrangements will be required to increase the contribution of 
knowledge to planning and policy making. 

A fourth condition is continued improvement of the stock of basic 
knowledge about information systems — their functions, elements, and 
operation — the source and user variables which limit their usefulness and 
their impact on planning. To date, very few real evaluations of the real 
operations of information systems have been made, failures have seldom 
been reported, and only a few sound generalizations on which to base 
technical and behavioral improvements in information processing have been 
verified. 

A final condition is that no major improvements to planning can be 
made without significant improvements to the training and experience of all 
of the personnel involved — politicians, planners, and representatives of 
interest groups. The quality of personnel is the single most important 
determinant of the quality of planning; without changes in the performance 
of planners, organizational and technical changes are likely to fail. 


Developing Social Accounts and Educational Indicators: 
On Guiding and Interpreting Educational Change® 


Only a small proportion of available statistics tell the planner anything 
about important social and educational conditions or about the magnitude 
and direction of change. Only a few are useful for charting the directions of 
change, for taking periodic readings of social movement, and for plotting 
course corrections. So, for example, education planners usually have more 
or less up-to-date information on such basic demographic processes as 
births, deaths, net migration to the areas, and on the performance of the 
economy. However, they do not have adequate information on crucial social 
processes such as discrimination, student progress and attainment, and the 
like. 

This problem cannot be solved simply by collecting more data or by 
making planners more voracious consumers of available statistics — the 
planner probably has more information now than he can effectively use. 


6In parts of this section I have borrowed freely from the work of the Educational 
Policy Research Center of the Stanford Research Institute. See their Toward Master 
Social Indicators, Research Memorandum EPRC-6747-2, February, 1969. 
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Instead, new ideas about improving the usefulness of our vast store of 
information and the instruments for making it available are required. 

The most promising recent thinking about social information systems 
centers around the development of a social report which would include 
indices of social progress or retrogression. In a recent publication, Toward a 
Social Report, the U.S. Office of Health, Education and Welfare described a 
social indicator as 


... a Statistic of direct normative interest which facilitates concise, 
comprehensive and balanced judgements about the condition of 
major aspects of a society. It is in all cases a direct measure of 
welfare and is subject to the interpretation that, if it changes in the 
“right” direction, while other things remain equal, things have 
gotten better, or people are “‘better off” (1969, p. 97). 


Thus, social indicators are different trom both social statistics and 
socio-demographic models of social systems. Social statistics are purely 
descriptive; they present data relevant to the question, “What are we 
doing?” Socio-demographic models add a theoretical element: “Can we 
describe what we are doing in terms of a theoretically meaningful model of 
social and demographic processes?”’ Social indicators add a normative 
element: ““How well are we doing?” So, for example, data on the number of 
doctors or teachers would be social statistics, not social indicators. But, data 
on health or literacy rates could be used as social indicators. 

The same report put the case for gathering or compiling a set of social 
indicators in this way: 


A social report with a set of social indicators could not only 
satisfy our curiousity about how well we are doing, but it could 
also improve public policy making in at least two ways. First, it 
could give social problems more visibility and thus make possible 
more informed judgements about national priorities. Second, by 
providing insight into how different measures of national 
well-being are changing, it might ultimately make possible a better 
evaluation of what public programs are accomplishing (1969, pp. 
Xii-xiii). 

Similarly, educational indices could be derived for monitoring and 
evaluating the performance of educational systems on a continuing basis. 
This is not to suggest that, with the effective incorporation of quantitative 
indices into the process, educational planning will become a simple matter 
of summing it all up. Rather, it emphasizes the need to understand better 
educational and social trends and the quality of educational programs in 
order that the policy needs might be determined, public programs might be 
evaluated, and the effects of legislation might be tested. 
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A Conceptual Model 


If social indicators are to be devised (their evaluative character must be 
kept in mind at all times), it is essential to develop a structure for the 
indicator system which distinguishes social goals and the needs of 
individuals from social service and highly abstract concepts from more 
readily measurable indicators of performance. Two quite different 
objectives are involved. One is essentially “normative”: to tell the planner 
which features of social life or which major areas of human concern should 
be examined. The other is descriptive: to demonstrate which measurable 
variables provide the best indication of movement toward, or away from, a 
given goal. 

Figure 4.1 is an attempt to develop a model which relates social goals 
and the needs of individuals to social services and which successively breaks 
down a number of highly abstract concepts into more precise components, 
to the point where relevant indicators can be identified. The model is 
intended to be used as an instrument of exploration and discovery. It is 
designed to explore the structure of the problem of relating goals to 
indicators, and to uncover promising leads in the derivation of statistical 
measures of social performance. 

The principal features of the model are described below. 

Institutions and individual sectors. In order to encompass the three 
basic starting points for a system of social indicators — social goals, the 
needs of individuals, and social services — the model is composed of three 
main parts. One describes the social system in terms of a set of normative 
dimensions or a cluster of social goals such as public order and safety, 
economic development, and environmental management. The second 
outlines a set of parallel concerns of individuals. The third characterizes the 
social services, both public and private, which have been established to help 
society achieve its goals and satisfy the needs of individuals. 

According to Figure 4.1, one of the major components of the social 
goals area is called “human resources development and maintenance.” A 
global measure, it is made up of four elements: Education and training, 
employment, health, and individual adjustment. The indicator question is 
“What progress is society making toward these goals?” 

The second side of the model raises a parallel set of questions about the 
concerns of individuals, but the indicator questions are different: ““How well 
are the needs of individuals being met?” “‘Is there discrimination among 
classes of people?” “On what basis — age? sex? race? religion?” “What kinds 
of needs are satisfied?” “What needs are not satisfied?” 

While the two sectors can be dealt with separately, the power of social 
accounting as a guide for policy making depends on relating the two in 
terms of input from social institutions — government, education, religion, 
business — and output for individuals and groups. For, although such 
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input-output-feedback relationships are exceedingly complex, they are 
critical, since the ways in which the inputs from social institutions are 
programmed and managed determine their impact on individuals. It is only 
when the two sectors are brought together that the basic policy question, 
“What adjustments are required in the delivery system if the needs of 
individuals and of society are to be better met?” can be answered. 

Thus, the third sector of the model — social services. Most societies 
have delivery systems, both public and private, operating in these areas. The 
indicator questions are “What kinds of educational services are available? 
How many of each? How many places in each? Are they adequate to meet 
needs or demands?” 

Needs, goals, and attainment. Since the basic emphasis of social 
indicators is on the evaluation of social progress or retrogression, the two 
most obvious elements of this model are goal and need specification, and a 
scale to measure the degree to which goals have been achieved and needs 
satisfied. These two elements are also the most difficult to come to grips 
with in a satisfactory manner, since both of them are intrinsically subjective. 

Leaving aside for the moment the question of the substance of goals, 
the measurement problem is to control this subjectivity, since it cannot be 
eliminated entirely. Thus, to avoid tying the model prematurely to a 
particular scale of evaluation, and to provide similar terms for both the 
individual and societal sectors of the model, three general attainment levels 
could be identified and given conventional descriptions — minimum, 
standard, and optimum. It is clear that such a scale could be a starting point 
only — depending on the purposes to be served by the evaluation and on 
improvements to current techniques of qualitative analysis, the three levels 
might be further subdivided and made more precise. 

Levels in the model. \n Figure 4.1, concepts related to social goals are 
arranged in a hierarchy, in descending order from the most general to the 
more specific, and a similar hierarchy could have been developed for 
concepts related to the needs of individuals. The highest level of abstraction, 
Level 1, is intended to provide overall assessments of the quality of social 
and political life. Formulations at the first level are highly abstract, perhaps 
somewhat vague, reflecting only in part on the dimensions of system 
performance and individual life. They can be thought of as the broad 
outlines of what a society desires ultimately to attain in social and 
individual life. 

The elements of these general, summary formulations constitute 
indicator areas, the second level of the model. Such areas are most likely to 
be a reflection of the dominant concerns of a society. For example, the 
report of the U.S. Office of Health, Education and Welfare (1969) lists 

seven indicator areas: environment; health and life; public safety; standard 
of living; race relations; opportunity; learning; science, and culture; and 
democratic values. The profile of indicators contained in Figure 4.1 is 
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different to the extent that Canadian national preoccupations are distinct 
from those of the U.S. 

But, these second level concepts must be further disaggregated to the 
point where more refined estimates of social performance and individual life 
can be obtained. Figure 4.1 shows this successive breakdown taking place 
over three levels, down to a complex, often overlapping, array of data at 
Level V. This process of disaggregation can be illustrated with a series of 
questions: What is meant by human resource development and 
maintenance? Employment? Education and_ training? Participation? 
Achievement? How can these be measured? What data will provide the best 
indicators of social progress or retrogression? 

It should be obvious by now that here we are faced with another 
critical stage in the development of indicators. A sound, theoretically 
meaningful, yet practical, procedure must be followed in the process of 
breaking goals into their component parts. And the relationships between 
adjacent levels must be testable, that is, subject to verification or disproot. 

In an important sense the process of disaggregation by defining 
indicator concepts and subconcepts can be thought of as being, essentially, 
the process of goal setting. This problem has two basic dimensions. The first 
is that goals can be set by omission as well as by commission. The very acts 
of including some goals and excluding others, and of treating some 
goals as global concerns and others as elements of larger concerns implies 
that some goals are more important than others or that certain goals should 
be viewed as instrumentalities toward others. The second dimension of the 
problem involves the tendency to include in the indicator system only those 
goals which can be expressed in operational or measurable terms. These 
problems are inevitable. They are dangerous only when the social 
accountant is unaware of them or makes decisions about them unwittingly 
or arbitrarily. 


Goals, Consensus, and Values 


The highest abstractions usually enjoy a high degree of consensus. For 
example, nearly all would agree that freedom is a desirable goal, because the 
notion is so flexible that each can read his own meaning into it. But this is 
not the case with more specific goals for they often imply means for 
attaining the more general goals, and agreement on means is much more 
difficult to obtain. 

There are two dangers inherent in basing indicators on politically visible 
themes. The first is that, although consensus on high-level goals may exist, 
the more operational statements may diverge considerably. An excerpt from 
Barry Goldwater’s The Conscience of a Conservative, demonstrates this 
point nicely: 
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I agree with lobbyists for federal school aid that education is 
one of the great problems of our day. I am afraid, however, that 
their views and mine regarding the nature of the problem are many 
miles apart. They tend to see the problem in quantitative terms — 
not enough school, not enough teachers, not enough equipment. I 
think it has to do with quality: How good are the schools we have? 
Their solution is to spend more money. Mine is to raise standards. 
Their recourse is to the federal government. Mine is to the local 
public school board, the private school, the individual citizen — as 
far away from the federal government as one can possibly go. 
(1964, p. 78). 


Similarly, social problems are increasingly being thought of in the 
context of the whole community and not only in terms of the people most 
immediately involved. So, for example, inequality of educational 
opportunity is now recognized as a problem for the whole community 
rather than only for underprivileged minority groups. 

The opposite extreme, ignoring existing conditions and discounting 
current trends too readily, is equally dangerous. Indeed, in a pragmatic 
sense, politically visible themes or issues of the moment provide the social 
accountant with an effective place to begin the actual work of data 
gathering and measuring social performance. 

A more useful and productive approach would be to assemble 
indicators that represent a range of possibilities: 


One might seek out some indicators dealing with the problems of 
existing institutions (like unemployment), and others that measure 
concerns nearer the horizon of possibilities (like the degree to 
which work is a creative and fulfilling process for people). 
Indicators that cover the entire span can help to show both where 
the most current, pressing problems lie and how rapidly the nation 
is moving toward longer-range objectives (Educational Policy 
Research Centre, 1969, p. 14). 


The value question. Unavoidably, the choice of social indicators and 
structuring attainment levels involves taking value positions since they imply 
that certain concerns are more important than others. Further, to begin an 
exercise in social stock-taking by moving into one area suggests that one set 
of conditions is satisfactory or below standard in comparison to other 
existing conditions. 

Judgements based on value positions become more prevalent as one 
moves from the level of “grand abstractions” to the more specific levels of 
goal attainment. The former are not entirely value-free or neutral, but their 
level of generality makes consensus more likely. However, in the process of 
disaggregation, as one addresses the means for arriving at measures of social 
indicators, the possibility of marked differences is created by the number of 
value positions that could be taken. 
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If excessive subjectivity is to be controlled, the structure of the 
indicator system must be balanced. That is, parity over a whole range of 
public concerns must be established, and the indicators must enable policy 
makers and planners to identify the underlying causes of social problems as 
well as their highly visible symptoms. Both require a high level of 
understanding of the system and of the interactions among its component 
parts. 


Structuring Attainment Levels 


The individual. Two assumptions underlie the notion of structuring 
attainment levels for the individual: first, human needs and values of 
widespread if not universal acceptance can be identified; and, second, these 
needs and values are in some sense linked and can perhaps be ordered in a 
hierarchy. 

There are numerous theoretical formulations available which could 
serve as Starting points or which, at the least, illustrate the possiblities of 
developing a rating scale. McClelland (1951) summarized the schemata of 
Kardiner, Kluckhohn, and other observers and concluded that the child in 
any culture must deal with broad problems of (a) protection and support, 
(b) expression and regulation of affect, (c) mastery of the external world, 
and (d) self-direction and control. 

A similar conceptual scheme was developed by Maslow (1954). He 
speaks of human beings as having intrinsic needs that must be fulfilled for 
full growth and development to occur. The needs he cites are (a) survival 
and safety needs, (b) security needs, (c) belongingness and love needs, 
(d) esteem needs, and (e) needs for self-actualization. 

Yet another analysis of needs was developed by Erickson (1953), who 
set out a series of five growth stages: (a) basic trust, (b) autonomy, 
(c) initiative, (d) industry, and(e) identity. 

Such categorizations might be used as the basis for describing an 
individual’s overall welfare, or more broadly yet, the quality of his life. 


To the extent that individuals can afford to be concerned with 
their higher needs and are little constrained by their lower needs, 
they are free to actualize themselves in whatever way is most 
natural to them. The more they are able to do this, the higher the 
quality of their lives. (Educational Policy Research Centre, 1969, 
pp. 18-19). 


Society. While some theoretical bases are available to give the 
delineation of individual attainment levels some form and direction, such 
straightforward developments are not available for establishing societal 
attainment levels. If it were merely a matter of juxtaposing the framework 
for individual attainment levels onto the societal structure, the task would 
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be relatively simple. But the complexity of the relationship between the 
individual and the society makes this impossible. Aronoff (1967), Gross 
(1966), Etzioni (1968), Tiryakian (1967) and Suchman (1967) explore the 
complexities of these interactions between the individual and society, and 
collectively their work suggests that a way to proceed might be to establish 
in an artibrary way several major goals for society. At this point one of the 
most challenging paradoxes facing those who would develop a procedure for 
social accounting is encountered. On the individual side of the model, there 
are theories available for structuring attainment levels, but very little data to 
work with. In the institutional sector many data are on hand but there is, as 
yet, no satisfactory way to structure attainment levels. 

For the present, at least, perhaps the best way to structure attainment 
levels in the institutional sector is to base them on the work of 
anthropologists such as Durkheim (1915) or on the insights of students of 
social change such as Moore (1963). Although their formulations are not 
precise, they are nonetheless instructive. So, for example, one possiblity is 
to set out for a society three major goal areas which might be ordered ina 
hierarchy in much the same way as Maslow (1954) ordered individual needs. 

The first level might refer to goals of maintenance or preservation, 
indicating conditions to be met to ensure the very existence of society. The 
second level could be characterized as goals dealing with the diffusion of 
benefits, and the third level, as goals of achievement and excellence. 


Educational Indicators 


While an educational accounting system might be considered as a 
special case under the broader perspective of social accounting, the initial 
stance taken would seem crucial to the direction and form taken by an 
educational report. For example, if the social view were adopted, the 
educational indicators should be addressed to broad social issues through an 
assessment of the interrelationships between education and society. A more 
limited, but not necessarily less useful, perspective would result from 
viewing the educational enterprise as a system per se. 


The Social View 


Viewed from the standpoint of society, educational accounting might 
take into consideration three major dimensions: social goals for education, 
the delivery of educational services, and educational attainment. The first 
considers the social purposes of education; the second looks at the 
availability of education in all forms; the third focuses on the questions, 
“Who benefits?” and “To what degree do they benefit?” 

The Social Purposes of Education. Few topics have been debated as 
much as the social (as distinct from individual) purposes of education, and 
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few debates have been as difficult to resolve. Yet, because of the norm-laden 
evaluative nature of social indicators, the social accountant must listen to 
this debate, take part in it, and seek at least (at most?) a tentative resolution 
of it. If he does not, the whole structure of the indicator system will be 
weakened, perhaps even destroyed. The purpose of the following brief 
discussion is to illustrate the possibilities. 

To begin, consider education as an instrument of social policy 
(education as a means toward individual ends is discussed later in terms of 
educational attainment). What does society expect of its educational 
systems? Are knowledge and education important avenues to political, 
social, and economic advance? What, for example, does a commitment to 
economic progress imply for education? Can all of these aims be achieved 
simultaneously? What aims are to be given priority? 


What kind of educational facilities should be made available? Technical 
institutes? Universities? “Free Schools”? Compensatory or remedial 
educational programs? Which should be available in the public sector? In the 
private sector? 

Who should benefit? Only the young, or adults as well? Primarily men, 
or should women be given equal educational opportunities? How are racial, 
ethnic, and socio-economic minorities to fare? 

Obviously, there are sharp divisions of opinion on the answers to these 
and many other similar questions, on the concrete expressions of aims. But 
the issue cannot be avoided, for it is only when aims are identified that 
movement toward or away from them can be measured. 

The delivery system. Following the guidelines laid down in the previous 
section, a set of indicators of the availability of educational services can be 
based on three levels. Each category is divided into sub-categories and a 
number of possible indicators are suggested. 

The level of minimal service concerns the availability of basic 
educational programs to members of society, particularly the poor and 
minority groups. Changes through time in the availability of special 
programs to combat illiteracy or inability to handle simple mathematical 
operations are possible indicators. 

At the second level — advanced benefits — services which allow students 
to advance in terms of both achievement and attainment, given their 
capabilities, are useful sub-categories. Possible indicators for this might 
include the availability of advanced and special educational programs. 

At the highest level — achievement and excellence — sub-categories 
dealing with education could encompass those services enabling students to 
gain and enjoy creative endeavors and a personally meaningful education. 
Possible indicators of the former could include the availability of literary 
publications, art exhibits, theatres, concerts, ballet, and opera. For the latter, 
the provision of a variety of educational options and of adult and 
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continuing education programs and changes through time could serve 
possible indicators. 

Educational attainment. In the preceding section, the indicator 
questions were “What services are available?” and “What amount?” In this 
section, the basic questions are “Who benefits?” and “To what degree?”’ 

The lowest level of educational attainment, the social minimum, might 
include two sub-categories: literacy and elementary arithmetic. Indicators 
for this level focus on the degree of illiteracy and incompetence in simple 
mathematics and their distribution by geographical area, income, 
occupation, and race. 

The second level, the amount of learning required for adequate social 
functioning, might be sub-divided into three components: (a) increasing 
educational achievement, (b) increasing educational attainment, especially 
among disadvantaged groups, and (c) education that pays economic and 
occupational dividends. Indicators that could be associated with the three 
sub-categories are, respectively, (a) national achievement tests, (b) average 
years of schooling by area, income, race, and status, and (c) the fraction of 
change in occupational status that is attributable to education. Cost-benefit 
analyses of different levels of education could be added to the last indicator. 

A third level for educational attainment, self-motivated education, 
could be divided into two categories: education that allows personal growth, 
and education that agrees with personal values and life-long personal 
growth. A number of indicators for the first sub-category are possible: 
measures of student alienation and disturbance, the degree to which persons 
in minority groups feel that their present education is meeting their needs; 
and tests of personality variables and imagination to see that these 
indicators, as well as strictly cognitive achievement, improve with schooling. 
Possible indicators for the second sub-category include the amount of 
schooling of people in relation to their age, income, or race; the percentage 
of people enrolled in continuing education; the strength of feeling among 
the elderly that they can no longer contribute to society and are no longer 
needed; and the number of persons engaged in self-directed learning. 


The Educational View 


Efforts to develop a procedure for stock-taking within the educational 
system itself, like those which aim at a social report or master social 
indicators, are in their infancy. The most recent attempt to develop an 
educational report goes under the title of the National Assessment of 
Educational Progress (NAEP). Its main features have been described in the 
following terms (Caps Capsule, 1960): 

1. NAEP is a response to the need to look at the outputs as well as the 

inputs of education. 

2. NAEP is designed to provide longitudinal data on progress in 

education. 
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3. NAEP is geared to providing information for people who govern 
education. 

4. NAEP assesses educational outcomes in the broad subject areas. 

5. NAEP is a program to assess all knowledge, skills, understandings, 
and attitudes acquired by children — throughout the country — 
within or without the school system. i 

6. A major goal in the development of the assessment items is the 
sampling of actual student behaviors; therefore, the item format is 
more varied than most standardized tests. 

7. Representatives of three audiences (scholars, educators, and lay 
people) are reaching to the assessment items. In the near future, 
students will also be used as reactors. 

8. Assessment data is not provided on individual students or school 
districts; rather, normative data is provided on the performance of 
broad groups of students. 

9. The assessment items represent three levels of difficulty. The data 
indicates what level of performance typifies the majority of 
students, about half the students, and the top ten percent of 
students. 


Certain observations about the NAEP program are worth making. In the 
first place, the accounting system is clearly oriented towards output 
measures, to the neglect of input and process measures. At some later time 
the assessment may attempt to link output measures with processes to 
furnish guidelines for improvements within educational systems, but 
presently this is not the case. Consequently, NAEP will not measure the 
effects of such factors as different curricula and the methods and quality of 
teaching on student achievement. Second, the approach seems to be aimed 
at assessing the actual performance of students in subject areas without the 
use of structured attainment levels. In this sense, the exercises developed for 
the evaluation of student performance differ markedly from the measures 
proposed for social accounts. Third, the usefulness of the total project is 
aimed at providing information for decision-makers at the national and state 
planning level and at the state and local administrative level. Finally, the 
bulk of the effort at this stage of the project’s life is being expended in 
accumulating and testing various measures of student performance with very 
large numbers of students. 


These observations emphasize the momentous nature of the task 
involved in gathering together possible indicators for an education-based 
accounting system. This initial effort is, of course, crucial, because further 
evaluating is dependent on the provision or derivation of useful measures. 

The direction that educational assessment will take on a broad front is 
far from clear. In fact, at the present time a great debate rages between 
proponents and critics. At issue are a number of questions. The first 
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concerns the relative advantages of NAEP: “Would a more broadly 
conceived study which examined the determinants of student performance 
as well as actual achievement be more worthwhile?” The second has to do 
with possible dysfunctional consequences: “Will educators become too 
concerned with the readily testable indicators of student performance?” A 
third involves the institutional location of the testing agency: “If effective 
use is to be made of all persons — teachers, students, parents, politicians, 
academics, and administrators — is a conventional university setting 
appropriate?” The last reflects on the current state of knowledge about the 
evaluation of educational performance itself: “Is enough known to 
undertake such a venture?” Articles by Beymer (1966), Tyler (1966), 
McMorris (1968), and Mollenberg (1969) cover the major points in this 
discussion. 


Linking Accounting Procedures and the Planning Process 


Knowledge, action, and evaluation are essentially connected. The 
primary and pervasive significance of knowledge lies in its guidance 
of action: knowing is for the sake of doing. And action, obviously, is 
rooted in evaluation. For a being which did not assign comparative 
values, deliberate action would be pointless; and for one which did 
not know, it would be impossible (Lewis, 1946, p. 3). 


In planning for social change, evaluative research (and social indicators, 
for they are a particular form of evaluation) supplies much of the 
knowledge base for the formulation and development of public programs. It 
provides knowledge about the structures and processes of programs, about 
specific target groups, about situational factors affecting the course of 
programs, and about differential effects. It serves to challenge traditional 
practices, to identify any unintended consequences of existing programs, to 
point out unproductive efforts of the past, and to sharpen the planner’s 
view of the future. 

Therefore, evaluative research is a basic ingredient of systematic 
planning and the list of its potential contributions to planning can be very 
long indeed. According to Suchman (1967, p. 141), evaluative research can: 


1. Determine the extent to which program activities are achieving the 
desired objectives. Measure the degree of progress toward ultimate 
goals and indicate level of attainment. 

2. Point out specific strong and weak points of program operation 
and suggest changes and modifications of procedures and 
objectives. Increase effectiveness by maximizing strengths and 
minimizing weaknesses. 

3. Examine efficiency and adequacy of programs compared to other 
methods and total needs. Improve program procedures and increase 
scope. 
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4. Provide quality controls. Set standards of performance and check 
on their continuous attainment. 

5S. Help to clarify program objectives by requiring operational 
definition in terms of measurable criteria. Challenge the 
“taken-for-granted” assumptions underlying programs. Point out 
inconsistencies in objectives or activities. 

6. Develop new procedures and suggest new approaches and programs 
for future programs. 

7. Provide checks on possible “‘boomerang” or negative side effects. 
Alert staff to possible changes of the program. 

8. Establish priorities among programs in terms of best use of limited 
resources — funds, personnel, and time. 

9. Indicate degrees of transferability of program to other areas and 
populations. Suggest necessary modifications to fit changing times 
and places. 

10. Advance the scientific knowledge base of professional practice by 
testing effectiveness of proposed preventive and _ treatment 
programs. Suggest hypotheses for future research. 

11. Advance administrative science by testing effectiveness of different 
organizational structures and modes of operation. 

12. Provide public accountability. Justify program to public. Increase 
public support for successful programs and decrease demand for 
unnecessary or unsuccessful ones. 

13. Build morale of staff by involving them in evaluation of their 
efforts. Provide goals and standards against which to measure 
progress and achievement. 

14. Develop a critical attitude among staff and field personnel. Increase 
communication and information among program staff resulting in 
better coordination of services. 


However, listing the advantages of a well developed program of 
evaluative research provides no assurance that it will be linked effectively 
with the planning process. The evaluator works in a world of action, of civil 
servants, and the recipients of social services, and the results of his efforts 
are a reflection, favorable or not, on vested interests. As such, then, 
evaluative research is subject to social constraints as well as to theoretical 
and methodological limitations, and these constraints set the limits of any 
evaluative study. 

In addition to the always present problem of resources — money, time, 
facilities, and competent personnel — the development of social indicators is 
influenced by six dominant social constraints. In the first place, evaluative 
research is affected by public demand and cooperation. The public is taking 
an increasingly active role in determining what goals should be pursued, 
what services it should receive and in requiring proof of the effectiveness 
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and efficiency of social services. And much of the success of pragmatic 
evaluative research depends on the voluntary cooperation of the public as 
subjects. 

A second major problem concerns the resolution of role conflicts 
among planners, policy makers, and administrators, among competing social 
groups, and within the structure of the indicator system itself. Such 
conflicts are not easy to deal with. Meaningful collaboration requires a 
considerable expenditure of time and effort on the part of those involved, 
the creation of organizational structures and channels of communication 
conducive to avoiding unnecessary clashes, and the clarification of the 
respective roles of the parties concerned. 

The third constraint has to do with the nature of the relations among 
various levels of government — local, regional, provincial, and federal — and 
changes in these relations over time. Obviously, decisions taken at one level 
are felt at the others, and decisions which affect the progress of a society 
toward its goals are made at all levels. There is another side to this problem 
as well: the division of responsibilities and efforts among the various levels 
of government. At stake are efficiency in government, the elimination of 
redundancies and the coordination of efforts, and the development of a 
consistent posture or value position, with respect to pressing social 
concerns. 

The fourth involves the reconciliation of different value positions in a 
unified procedure for social accounting, and inclusion, in the indicator 
areas, of as much of the spectrum of social values as possible. It is unlikely 
that complete agreement on social concerns, program objectives, and the 
criteria of success can ever be achieved. But if the indicator system is 
completely haphazard, and if it contains significant gaps, the system will 
have, at best, only limited usefulness. 

The fifth constraint, that of obtaining agreement on the structure of 
attainment levels, is closely akin to the fourth. Both highlight the problems 
to be encountered in modelling the indicator system. It does the evaluator 
or planner little good to ignore these problems and to develop a system with 
a logic of its own, independent of the hurly-burly of policy making. Rather 
than changing people and problems to fit the system, the system should be 
adapted to the imperatives of the situation. 

A final constraint is that the role of social indicators will be whatever 
planners and policy makers assign to them. There is no guarantee that an 
evaluative study will be a prelude to change in public policies and programs. 
Organizations and program staff resist challenges to traditional practices and 
entrenched power. The public, once accustomed to a particular program, is 
likely to resist having it curtailed or eliminated, even if the program has 
outlived its usefulness. In short, the question of whether or not the results 
of an evaluative study will be implemented will be answered, not in terms of 
the scientific quality of the study, but in terms of the attitudes of policy 
makers, planners, and the public toward change. 
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IMPROVING RESOURCE ALLOCATIONS IN EDUCATION 


Thus far, this review has stressed the sociological and normative 
frameworks within which something called education planning must take 
place; the allocation of financial resources to educational programs has not 
been discussed. Yet, despite what has been said (and will be said again) 
about the primary importance of these preconditions for planning, there is 
still an economic task which must be understood if we are to gauge 
correctly the nature of the education planning process. 

The planner must deal with two questions: first, how should public 
funds be allocated to the educational system? That is, given the steady 
growth of the educational enterprise and the ever-increasing demand for 
other social services — in short, all of the claims on the public purse — is it 
possible to arrive at a procedure for allocating resources so that some 
balance over all public expenditures can be realized? 

Second, whether or not it is possible to achieve this parity, how can the 
educational system itself become more efficient and allocate resources to 
different programs more rationally? What economic tools can be brought to 
bear? What are the needed adjustments and additions to current procedures 
for making decisions about the allocation of funds? 

There are analytic tools, taken principally from economics, which can 
be applied to the development of quantitative approaches to decisions in the 
public sector. The tools, including cost-benefit analysis, cost-effectiveness 
analysis, PPBS, and input-output analysis, do not, however, offer neat 
solutions to the planners: 


it must ... be made clear that quantitative planning is not an 
alternative to common sense; it cannot replace common sense and 
it should not. It does supplement it, particularly with regard to the 
orders or magnitude of the phenomena involved. In planning, all 
information and all methods available should be put to use. 
(Tinbergen, 1958, pp. 9-10). 


Toward Designs for Rational Decision in Education 


Planning requires an awareness of available resources and competing 
priorities. In education, the demand for resources is usually higher than the 
supply, and funds for the implementation of all programs which seem 
necessary generally cannot be found. Further, there is an opportunity cost 
associated with appropriations, since the amount spent on one program 
limits the amount available for other programs. So, in economic terms, the 
planner’s problem is to allocate the available level of resources to programs 
in such a way that a maximum contribution to the system’s objective 
function can be realized. Or, more formally, to achieve optimum levels of 
expenditure, the benefits of marginal resources used for a particular purpose 
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must be just equal to the benefits which could be obtained from the best 
alternative use of those same resources. Thus, whatever the goal priorities 
may be, the assessment of opportunity costs, that is of benefits foregone, is 
at the core of decision making. 

It is rare indeed for a policy or plan to carry with it a full recognition of 
its social and individual consequences. In this sense, at least, it is unlikely 
that education planning can ever become fully rational. In general, however, 
attention to a number of central issues or concepts can help to make 
decision making in education as rational as possible in most situations. 
Seven of them will be mentioned here, but only in passing. MJ. Bowman 
(1966) and Richard Musgrave (1959) deal with them at length. 

The first two issues center on the equity-economy problem in 
education. Equity, asa “universal human right”, however it is defined (for 
example, an equal amount of education for everyone, the amount of 
schooling needed to bring all students to a given standard, or to enable each 
child to reach his potential), is a widely proclaimed goal of education. It is 
an ambiguous guide for the education planner since each variation of it has 
different implications for policy. But in the context of incremental social 
change, where systems approach goals through step-by-step approximations, 
it is also one of the most important normative guides to investment in 
education. 

Economy, on the other hand, implies determining an appropriate level 
of financial support for educational programs.! Much can be made of the 
inherent conflict between standards of equity and appropriations to 
education and rightly so, since trade-offs between them are always 
necessary. The amount of money available for public purposes is limited, 
and the supply of funds is never adequate to meet the demand for services. 

The third issue concerns scales for the comparison of alternatives. It is 
not easy to develop detailed measures of the outcomes of public services in 
quantifiable, comparable units. Planning decisions usually have 
multi-dimensional consequences: they involve costs and benefits stated in 
different value units — monetary costs and benefits, psychic benefits, 
external effects, and so on. Thus, such measures should not be used as the 
sole determinants of public policy, but to provide estimates of the relative 
magnitudes of certain benefits that are likely to result from different 
programs. Therefore, they “‘can be used to compare programs and to show 
what must be given up in terms of measurable benefits to attain goals in 


IT some, the term “economy” also connotes efficiency, that is, getting the most 
trom the least, whatever the goals may be. This connotation is a critical one to the 
planner for it requires an understanding of how particular outputs are affected by 
changes in inputs. I will leave the issue of efficiency aside for the moment and return 
to it later in this chapter. The concepts of equity and efficiency are not in conflict — 
the analysis of internal efficiency implies nothing about the appropriateness of 
educational goals or outputs — whereas in the real world of limited resources, the 
notions of equity and economy inevitably come into conflict. 
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areas where benefits are not subject to measurements.” (Miner, 1967, p. 
314.) 

The comparison of the costs and benefits of various alternatives also has 
a time dimension, for programs must be weighed against each other both at 
a given point in time and along different time paths. This not only involves 
the problem of timing social change but raises the more basic question of 
time preferences — choices between enjoying immediate benefits at the 
expense of later ones or sacrificing early benefits in order to obtain greater 
returns in the long run. 

The fifth and sixth concerns, the pace of change and the problems of 
choice under uncertain conditions, are closely connected to the time 
orientation of the planner. Both are governed largely by factors which rest 
outside the control of the planner and both impose rather tight boundaries 
on his rationality. If the planner’s assumptions about these factors are 
unnecessarily arbitrary or inflexible, his range of effective intervention into 
the system is seriously limited. If, on the other hand, the planner adopts a 
more pragmatic posture and learns readily from feedback, the range for 
innovative policies remains enormous. The most popular examples of 
“planning gone wrong,” including those which cite the bureaucratic pitfalls 
of planning in the U.S.S.R. and those which identify public resistance to 
overly ambitious plans, illustrate the problems. 

The final dimension is a matter of identifying human and organizational 
constraints upon decisions. The planning problem is that of identifying and 
programming a path which will move a system from some initial state to a 
preferred terminal state. In most situations there will be one or more initial 
positions, one or more terminal conditions, and many different paths 
connecting them. But not all possible paths will be feasible. The range of 
effective strategies is constrained by precedents set within the system itself, 
by the physical and psychological characteristics and experience of its 
members, and by the system’s social, political, and economic environments. 
These constraints vary greatly in nature and in their impact on the planner’s 
range of options, but they are particularly important when planning 
decisions do not fall into the “routine” category. Their effects are not 
necessarily negative, for the planner can utilize them to secure commitment 
to his programs and to motivate their implementation. 


Systematic Analysis and Resource Allocation Decisions: 
Summary Comments on Selected Methods 


A number of economic models have been devised explicitly to handle 
the above mentioned seven planning concerns. They aim at reducing 
uncertainty and increasing rationality in human judgement with the hope 
that financial allocations will be made more effectively in environments of 
uncertainty and resource scarcity. Four of these models — cost-benefit 
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analysis, cost-effectiveness analysis, PPBS, and input-output analysis — are 
especially significant here because of their increasingly widespread use in 
social planning. 

Certain basic conceptual similarities underlie the four models. In the 
first place, the problem of allocating resources to educational programs is 
viewed in two ways with regard to time: the decision framework is a priori 
if no programs exist and there are resources to allocate, but if programs are 
in operation, the planner should consider an a posteriori, evaluative 
framework. 

Second, all four measure benefits, although units of valuation vary: the 
present net value of future benefits in dollars; effectiveness across a number, 
of objectives measured either in terms of dollar return on investment or in 
terms of some other value standard; and multiple output criteria, which can 
include both money and other units of value in a single analysis. 

The third problem, defining efficiency, is closely related to the question 
of valuation. Wildavsky (1966, p.262) points out that efficiency, when used 
in an economic context, has three accepted basic meanings: 


1. Pure efficiency is aimed at meeting the objective at the lowest cost 
or obtaining the maximum amount of the objective for a specified 
amount of resources. 

Mixed efficiency is obtained from a situation in which the 

desirability of trying to achieve certain objectives may depend on 

the cost of obtaining them. Mixed efficiency results, therefore, from 
the analyst’s alteration of the objective to suit available resources. 

3. Total efficiency results from the analyst’s accomplishing efficiency 
by not only altering the means and the ends (resources and 
objectives) but by making them dependent on changes in political 
relationships. 


i) 


In general, these definitions can be used to draw further distinctions 
among the models. Cost-benefit analysis is concerned with pure efficiency, 
that is, with meeting a stated objective at the lowest cost or obtaining a 
maximum amount of the objective for a specified amount of resources. 
Cost-effectiveness analysis is based on attaining mixed efficiency, the 
alteration of the objective to suit available resources. Program-budgeting 
leaves pure and mixed efficiency far behind in its over-reaching grasp into 
the structure of political decision-making and the frequent requirements 
that the structure itself be changed. 

Finally, the four models generally involve different planning horizons, 
ranging from arbitrary horizons based on the life of a program to a complete 
operation of the system. Cost-benefit analysis is generally applied to 
programs, cost-effectiveness analysis to systems. An example might help to 
clarify the distinction. Suppose that government was concerned with the 
evaluation of manpower policy. Cost-benefit analysis would be useful for 
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examining specific programs such as retraining the unemployed or the 
disabled to give them marketable skills. Cost-effectiveness analysis, on the 
other hand, could be used to address broader, more diverse questions: What 
should be the mix of programs in the manpower retraining system? Are the 
various programs equally potent? What factors external to programs 
influence their operation? And, is the manpower retraining system, on the 
whole, meeting its objectives? 

Table 5.1 (adapted from Temkin, 1969, p. 18) compares the four 
models. Each is discussed at greater length in the following sections of this 
chapter. 


Cost-Benefit Analysis 


Cost-benefit analysis, which alternatively has been called investment 
planning or project apprisal, has been described by Wood and Somers (1969, 
p. viii) as a procedure for 


measuring the benefits and costs of an investment and then 
comparing them: if the benefits exceed the costs, the welfare of 
the investor is increased. Where alternatives are available the 
appropriate investment is indicated by the highest benefit-cost 
ratio. 


Thus, cost-benefit analysis can be a practical way of estimating the 
desirability of projects when it is important to examine the long-term 
repercussions of a program and to identify as many effects of the program 
as possible. 

The use of cost-benefit analysis is commonly supported on a number of 
grounds. According to Prest and Turvey (1965, p. 730): 

1. it forces those responsible for decisions to quantify costs and 
benefits as far as possible, rather than rest content with vague qualitative 
judgements or personal hunches; 

2. quantification and evaluation of benefits, however rough, does give 
some sort of clue to the charges which customers are willing to pay for 
certain services. 

In a similar vein, it can be argued that cost-benefit analysis can force 
decision-makers to: 

1. specify all the particular effects the decision-maker should look at; 

2. indicate which effects are measurable and which are not, 

3. try to measure the effects that are measurable in monetary terms. 


Underlying Principles 


Cost-benefit analysis draws on several of the traditional areas of 
economic study: welfare economics, public finance, and resource 
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economics, but the branch of economics which constitutes the theoretical 
basis of cost-benefit analysis is micro-economics, the science of rational 
choice. 

The notion of cost-benefit analysis is deceptively simple. It requires 
only that we identify the costs and benefits associated with the perceived 
alternatives. Once the costs and benefits of alternatives have been estimated 
in commensurable units, one can select the alternative that yields the 
greatest benefits for a given level of investment, or that which will yield a 
given level of benefits for the least cost. . 

The purpose of cost-benefit analysis can be stated more formally: the 
aim is to maximize the present value of all benefits less that of all costs, 
subject to specified constraints. And, the decision rule for maximizing the 
present value of total benefits less total costs can be expressed in either of 
two equivalent ways: 

1. select all programs where the present value of benefits exceeds the 
present value of costs; 

2. select all programs where the internal rate of return exceeds the 
chosen rate for discounting the values of benefits. 

While such formulations are general, they do imply a series of 
questions, the answers to which constitute the underlying principles of 
cost-benefit analysis and outline the basic theoretical and methodological 
issues raised in the application of it: 

1. Which costs and which benefits are to be included? 

2. How are they to be valued? Costs and benefits for whom? 

3. At what interest rate are they to be discounted? 

4. What are the relevant constraints? 

The four issues are not of the same magnitude. The last two can be handled 
quite readily in virtually any analysis. The first two are the most important 
in cost-benefit studies and by far the most difficult to resolve. 

Identification of costs and benefits. The obvious starting point of 
cost-benefit analysis is specification of the nature and scope of the program 
to be analyzed. The establishment of clear parameters for the program can 
be straightforward if it bears no direct or indirect relationship to other 
ventures. But this is seldom the case, for the allocation of resources to one 
undertaking precludes their use for other programs. There needs, therefore, 
to be clear recognition that when the project is placed within the boundaries 
of some system, assumptions are made about the effects or non-effects of 
the project on other parts of the system. The full range of benefits and costs 
associated with a particular program includes not only the obvious costs and 
benefits internal to it, but also opportunity costs and externalities, that is, 
the wide class of costs and benefits which accrue to bodies other than the 
one sponsoring the project. 

The problem is not merely one of identifying and valuing the 
externalities (and this can seem insurmountable in itself), but one of 
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determining the extent to which the sponsoring body should take them into 
account. In this connection, McKean’s advice (1958) is probably the 
soundest: public investment projects should take into account the external 
effects of their actions in so far as they alter the physical production 
possibilities of other producers or the satisfactions that consumers can get 
from given resources. 

Externalities also appear under another guise, that of secondary 
benefits. The American discussion of this matter has centered on the benefit 
estimation procedures used by the Bureau of Reclamation in its analysis of 
irrigation projects. Eckstein (1962) and Margolis (1957) discuss these 
procedures at length. 


Valuation of costs and benefits. Cost-benefit analysis has come to be 
primarily a tool of econometricians. In other words, the use of cost-benefit 
analysis in examining public poiicy has come to imply a particular 
disciplinary perspective on social programs and a particular unit of 
valuation, namely money. 

Yet it is obvious that planning decisions usually involve 
multidimensional consequences, that is, costs and benefits which cannot be 
stated in the same, or commensurable, units. For example, when measuring 
the costs and benefits of a graduate education, many costs can be measured 
in money — for instance financial outlay and foregone income while the 
student is enrolled in university — as can some benefits, including an 
increase in earning power upon completion of the graduate program. But 
many other costs and benefits can not be measured readily (or comfortably) 
in monetary terms — for instance, psychic costs and benefits. Even a passing 
familiarity with the literature is enough to demonstrate that this problem is 
at the heart of the mounting criticism of cost-benefit analysis of social 
services. Why is it, then, that these multidimensional consequences have 
seemingly been ignored? John S. MacDonald (1969, p. 30) explains it by 
suggesting that cost-benetit analysis has become the province of a discipline 
not well-equipped to handle them: 


Some five years ago, when [cost-benefit analysis] was just gaining 
widespread support, many of its leading protagonists saw it as a 
way of introducing a humanistic or humanitarian approach to 
applications of theories of choice for the commonweal. They have 
not, however, taken an active part in developing social cost-benefit 
analysis and, instead, have become dissatisfied as this method has 
become increasingly the work of econometricians. Since 
econometricians concentrate on data which are already measured 
in monetary terms, the complaint that cost-benefit analysis has not 
incorporated a wider range of measurable indexes is not justified. 
Nor can one complain that more so-called intangibles have not 
been taken into account. These are not the proper business of 
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econometricians ... Why have not sociologists or political 
scientists contributed more to the expansion and elaboration of 
comprehensive project appraisal? 


While a definitive solution to this problem is unlikely in the near future, 
it is increasingly receiving the attention it deserves. Most writers have 
suggested that cost-effectiveness analysis is a natural replacement for 
cost-benefit methods for cases in which benefits are not commensurable and 
inappropriate for valuation in dollars. Vedder (1970) has argued that since 
the marginal utility of a dollar has a subjective quality (for example, it 
differs among socio-economic groups and at various levels of income or 
expenditure), “what is needed in principle are valwe-commensurate units, 
equivalent in the sense that they reflect individual or social preferences, 
rather than equivalent natural units (pp. 112-113). Although the 
measurement difficulties which follow from taking up Vedder’s suggestion 
would be staggering, his idea is worth pursuing further, particularly because 
so many of the most important planning decisions involve questions of 
marginal costs and benefits. 

Returning to costs and benefits which can be expressed in terms of 
money, it is generally agreed that adjustments need to be made to the 
expected prices of future inputs and outputs to allow for anticipated 
changes in relative prices. This involves the discounting of future money 
streams to a focal date which, for the sake of convenience in estimation and 
comparison, is set at the date of a project’s anticipated beginning. 

The estimation of future cash flows may use straight projection from as 
much longitudinal data as can be assembled, or it may entail the use of 
cross-sectional data. In either method, certain assumptions are made about 
the price fluctuations of the economy. Where marked changes in relative 
prices occur in the future, the initial valuations of costs and benefits will 
give an incorrect picture of a project. Two observations about this point are 
made by economists: the first is that economic trends show that price levels 
between different sectors are relatively stable and the second is that the 
estimations of cash flows which have most bearing on cost-benefit ratios are 
those made in the time periods close to the project’s initiation. Over- or 
under-estimation of cash flows after the first ten years is almost 
inconsequential, because in discounting the value of flows for later periods 
the effect of quite marked changes is largely diminished. 


Choice of interest rate. The point has already been made that cash 
flows in a cost-benefit analysis are discounted back to some focal data. What 
level of interest rate or rates to adopt for this purpose has been a 
controversial issue. Even when a single or average risk-free long-term rate is 
used, there are arguments about whether market rates of interest bear any 
close relationship to the marginal productivity of investment and time 
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preference. The appropriateness of rates is fully discussed by Prest and 
Turvey (1965), who say: 


In practice, the most usual kind of procedure is to select an 
interest rate or rates, on the basis of observed rates ruling at the 
time, for calculating present values ... The choice of varying 
discount rates, does not, within the 4-8 percent band, make much 
difference to assessment of a project (p. 700). 


Relevant constraints. The planner’s choice of a preferred program must 
be made from among a set of feasible alternatives. As politics is, in one 
sense, the “‘art of the possible,” so too is planning. 

The distinctions between those alternatives which are feasible and those 
which are not can be drawn most usefully in terms of constraints. Eckstein 
(1961) places relevant constraints into six categories: physical, 
administrative, legal, uncertainty, distributional, and budgetary. Judy’s 
seven-fold classification (1969) is somewhat more useful for education 
policy makers and planners: technological constraints reflecting the state of 
existing technology; policy constraints imposed by superiors on 
subordinates; political constraints defined by _ political conditions, 
organizational, constitutional, and legal constraints reflecting the division of 
powers, interests, rights, and responsibilities among institutions; resource 
constraints imposed by the supply of money, materials, personnel, and so 
on; target constraints reflecting a firm commitment to given goals; and 
imaginary constraints (those which are felt but have no foundation in 
reality). 

In many respects, the planner’s task is to work on these constraints, 
modifying them, adding to them, or eliminating some of them. If these 
constraints do not prevent the planner or policy maker from choosing his 
most-preferred alternative, they are painless. But if they remove the 
most-preferred course of action from the, list of feasible programs, their 
effects are far-reaching, binding, and costly. 


Continuing Controversies 


The application of benefit-cost methods of analysis to the evaluation of 
social services and human resource development programs has been 
surrounded by three major issues. For the sake of brevity, they may be 
referred to as the normative, the analogy, and the validity questions. 

The normative question is discussed fully by Chamberlain (1969) who 
warns that human capital analysis, in its disciplinary preoccupation with 
economic rationality and efficiency, ignores the welfare of people, and may 
well result in the same degree of intellectual excesses which characterized 
the scientific management movement of the turn of the century. The 
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questions raised by Chamberlain and others are likely to prove especially 
troublesome for those policy makers who would base their choices on 
benefit-cost analyses. Which benefits are to be valued? Returns to whom? 
Should the analyst accept the values of the system as a whole and exclude 
from his appraisal the competing values of minority groups? How 
appropriate are monistic standards of value and present criteria of 
efficiency? 

The analogy question concerns the transfer of the concept of capital to 
persons. Expenditures on human capital formation can be likened to outlays 
on other forms of capital; the disbursement of goods and services in the 
educational sector precludes their use for other purposes. The educated 
person can be said also to possess a stock of capital, for which he receives a 
series of returns in future years. 

But expenditures on education also differ from expenditures on 
physical capital. Eckhaus (1962) indicates that the process of human capital 
formation not only develops labor skills but locates them as well. The 
result is both an improvement in quality and an increase in the quantity of 
talent. Wilkinson develops this theme further: 


The talent so developed can be employed not only in 
production of consumer goods, physical, and human capital, but 
also in invention and innovation along scientific, technical, or 
adminstration lines. Furthermore, human capital is likely to be 
more flexible in the number of different jobs it can perform than 
are many types of physical capital (1966, p. 7). 


Such remarks focus on the output or benefit side of the investment. On 
the cost side, the difference between human and nonhuman capital is even 
more apparent. When expenditures are made on physical capital, then the 
outlay is undisputedly investment, but expenditures on education have a 
consumption in addition to an investment aspect. Furthermore, the 
proportion of one element relative to the other is unclear. In the light of 
difficulties associated with separating consumption from investment 
expenditures, Wilkinson suggests that all educational outlays can be treated 
as investment: 


This procedure is not entirely satisfactory but it is to be hoped 
that as more becomes known about the purposes for which people 
obtain education and the contribution to productivity which 
various subjects make, a less arbitrary method might be possible 
(1966, p. 9). 


Finally, there is what may be called the validity question. The debate 
centered on this question has to do with the appropriateness of the 
rate-of-return methodology used in the cost-benefit studies of human 
capital. The argument turns around several major issues: the implication 
that expected lifetime net earnings form the basis of a national method 
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calculating educational and occupational choice; the inclusion of foregone 
earnings as one of the costs incurred by investors in education; the merits of 
estimating expected lifetime earnings from cross-section earnings data as 
opposed to estimates based on longitudinal or time-series projections; and 
difficulties in isolating the effect of education on earnings. These and 
related issues are fully discussed by Blaug (1968). 


Applications of Cost-Benefit Analysis 


The use of cost-benefit analysis to evaluate programs in the public 
sector of the economy has largely been confined to the areas of water 
resource development, transportation, and national defense, although there 
is a growing body of literature describing its use in evaluating social delivery 
systems. In each case the technique has demanded a specification of 
multidimensional outcomes in terms of dollar benefits. The often-used 
example of water resources development systems is a good one. While the 
primary monetary benefit of such a project might be the dollar value of 
electrical power generated, there are other benefits, some of which can be 
assigned monetary values (such as relief from flooding and the sale of water 
for irrigation), others which are highly intangible (such as the psychic 
well-being of persons relieved from the fear of floods), and still others which 
are mixed (such as the development’s recreational potential). 

The application of cost-benefit anlysis in education has occurred at two 
levels: the first is at a case level at which the private rate of return is utilized 
to estimate the costs and benefits of education for particular persons. 
Examples of this approach have been described by Rogers (1968) and Blaug 
(1967). The second utilizes highly aggregated educational and income data 
for states, regions, or nations. This is understandable, for it is chiefly at such 
levels that the required data are readily available. Thus, Becker (1962) 
explored the social return from college education as measured by its effects 
on earning and productivity, and concluded, among other things, that 
“private rates of return on college education exceed those on business 
capital”. Hansen (1963) calculated internal money rates of return for 
successive increments of schooling where returns were estimated from 
cross-sectional data of the incomes of individuals, classified by age and years 
of schooling. The last two studies mentioned were on United States data. 
The most extensive study done to date on Canadian data was recently 
completed by Stager as a doctoral dissertation at Princeton University 
(Stager, 1968). It addressed two major questions: the social and private 
monetary returns to all forms of post-secondary education in Ontario and 
an economic evaluation of the year-round operation of post-secondary 
institutions in that province. 

The extensive literature describing these applications to education prior 
to 1966 has been well reviewed by M. J. Bowman (1966). Much of the more 
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recent literature has been abstracted by Research for Better Schools, Inc. 
(1968). Blaug’s article (1968) provides an excellent overview of the 
recurring issues in the cost-benefit analysis of educational programs. 


Summary Comments 


There is general agreement about the usefulness of cost-benefit analysis 
where the costs and the benefits of a program can be readily expressed in 
monetary terms. But in many instances, and education is one of them, it is ~ 
extremely difficult to be precise about the quantification of inputs and 
benefits. Even if it were possible to quantify many more educational 
outputs, each must be priced in order to be incorporated into a cost-benefits 
analysis. Current research dealing with private and social investment in 
education attempts to circumvent this problem by limiting the analysis to 
generally accepted monetary costs and benefits. 

It is difficult to visualize the application of cost-benefit analysis to 
programs at lesser levels of aggregation, for example, at the school district 
level. Since the boundaries of educational districts are seldom coterminous 
with the boundaries of other governmental units, economic indices are not 
available at the level of individual schools or school districts. And, even if 
such indices were available,. cost-benefit analysis would be inappropriate 
because of the mobility of student populations within and between school 
districts, and other difficulties related to identifying long-range economic 
benefits for educational units as small as individual schools. 


Cost-Effectiveness Analysis 


It should be clear from the preceding short discussion that cost-benefit 
analysis is applicable to a rather small, although nonetheless important, set 
of planning problems in education. It is not applicable to the wider class of 
problems where program benefits cannot be valued in dollars, or where the 
focus on economic benefits is too narrow for the planner’s purposes. In 
these cases, where inputs can be assigned a dollar cost but where outputs 
must be measured in non-monetary terms, cost-effectiveness analysis is the 
natural substitute for the benefit cost method, provided that some measure 
of utility other than money can be found. 

In principle, cost-effectiveness analysis does not differ from what has 
variously been called operations research, systems analysis, or systems 
engineering except, perhaps, in its emphasis on cost factors. It is an analytic 
framework designed to supplement the intuition and practical judgement of 
the planner by enabling him to view a problem in its entirety, to identify 
and describe possible solutions for it, and to compare alternative courses of 
action in terms of their cost and some aggregate measure of their worth. 
Characteristically, it will 


12 


IMPROVING RESOURCE ALLOCATIONS 


involve a systematic investigation of the decision-maker’s objectives 
and of relevant criteria; a comparison — quantitative where possible 
— of the costs, effectiveness and risks associated with the 
alternative policies or strategies for achieving each objective; and an 
attempt to formulate additional alternatives if those examined are 
found wanting (Quade, 1967, p. 2). 


Some operational definitions of effectiveness have been exceedingly 
complex. For example, alternative designs for the Anglo-French Concorde 
and the American S.S.T., two supersonic transports, were evaluated on the 
basis of a model which related traffic forecasts, airplane characteristics, 
route characteristics, revenues, passenger preferences, and levels of 
operation (Lifson, 1968). More typically, at least in education, actual 
applications involve a single objective and a single criterion of effectiveness, 
not multiple measures of each. 


Elements of the Analysis 


Planning can be defined as a process of making decisions for the future. 
So, we are brought to the question, ““Must the planner wait for the arrival of 
the future to determine the effects of his decisions?” The answer is “Yes... 
but ... — “‘yes” because he can never know the shape of the future 
completely, and “but” since relevant features of the situation can be 
described in a model which can, in turn, be used to simulate the effects of 
an activity over time. Such models — whether they are computer programs, 
mathematical formulations, operational games, or even Delphi studies — are 
at the core of cost-effectiveness analysis. Because models are imperfect 
representations of reality, solutions extracted from them should never be 
thought of as the best solution for the real problem — but they can bring 
the planner to a clearer understanding of the problem and its setting. 


Yet models, although they are of central importance in estimating the 
performance of alternatives, do not stand alone in cost-effectiveness 
analysis. In all, there are six elements in this approach to solving planning 
problems: 


1. Objectives. In formulating a problem for analysis, the first question 
to be answered is “What are the policy-makers’ and planners’ objectives?” 
Although the question is an obvious one, it is often a hard one; analysts, like 
doctors, are usually confronted by symptoms, not by a ready definition of 
the problem. The process of diagnosis, then, is a prelude to formulating 
objectives for the system and establishing criteria for evaluating alternative 
courses of action. 

System objectives, at least in the early stage of the analysis, are not 
static. They are reformulated as circumstances change, as alternatives 
become unattractive, and as the gap between alternatives and the statement 
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of objectives becomes too great. But even a tentative formulation can be a 
valuable criterion for reducing the analyst’s problem to managable size. 

2. Alternatives. Careful analysis of the policy maker’s objectives is 
likely to uncover a variety of potential means by which it is felt the 
objectives can be reached. These alternatives need not be substitutable, 
made up of the same components, perform the same functions, or have the 
same schedule. Thus, for example, the range of feasible programs available 
to a government concerned about inequality of opportunity in 
post-secondary education includes such diverse possibilities as eliminating 
tuition fees, making direct grants to needy students, establishing a loan 
fund, or establishing new institutions to meet special needs. 

3. Costs. While costs can be thought of in terms of simple 
expenditures, they are more accurately measured as negative benefits, that is, 
as opportunities foregone. Nor are costs to be valued only in terms of 
money outlays — they must include all benefits which have to be given up 
to obtain a greater benefit, particularly time, depletion of scarce resources, 
and the use of available human skills. 

4. Models. The essential purposes of the analyst’s models can be 
described in two words — experimentation and prediction. With models 
which represent the relevant interactions among the most salient features of 
the system, the analyst may rationally construct, examine, and evaluate 
alternatives and devise trade-offs among them. In turn, the results of this 
work provide the quantitative information the policy maker and planner 
require if they are to select an optimal course of action. 

5. Criteria. In order to weigh cost against effectiveness, to rank 
alternatives in order of their desirability, and to identify the most promising 
course of action, a decision standard must be formulated. Perhaps the two 
most often-used criteria are “‘given a fixed level of effectiveness, minimize 
costs”; and “given a fixed cost, maximize effectiveness’. These rules are 
obviously the extremes on the continuum of available criteria: they are the 
boundaries of the solution to any cost-effectiveness analysis. The optimal 
solution usually falls between them. 

6. System Life-Cycle. The effectiveness of educational programs must 
be considered in relation to their complete life-cycles: the time required to 
realize their benefits and become obsolete. Thus, time can properly be 
thought of as a cost; in some cases it can even be valued in money. This 
cradle-to-grave view of systems is especially critical in education — where 
planning decisions are often made with an exceptionally long program 
life-cycle in mind — and it can greatly complicate the task of analysis and 
evaluation. It is important in another sense as well — its implications for the 
budgetary process and the time-phased allocation of resources to programs. 
We will turn to this question later, when we examine a new approach to 
budgeting, the “Planning, Programming and Budgeting System” (PPBS). 
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The Process of the Analysis 


The elements of cost-effectiveness analysis imply a theoretical logic for 
ordering the steps in the process. The process is set in motion with the input 
of information about the environment, about the need for new programs, 
about relevant constraints, about alternative courses of action, and so on. 
The ordering of this information precedes the formulation of the problem 
and the definition of a value model — the criteria of system effectiveness 
which makes optimization possible. Alternatives for meeting system needs 
may then be generated, tested with the model, and assessed in terms of the 
effectiveness criteria. It is unlikely that this stage will provide an optimal 
solution — alternatives must be recycled and revised in the search for an 
acceptable solution. Although this evaluation loop leads most often to the 
modification of alternatives, it occasionally uncovers weaknesses in the 
value model which need to be remedied. Finally, when a satisfactory 
program has been selected, it is transmitted to planners and policy makers 
for a decision. 

Kazanowski (1968, p. 116) has outlined a ten-step standardized 
approach to the conduct of cost-effectiveness evaluations: 

1. Define the desired goals, objectives, missions, or purposes that the 
systems are to meet or fulfill. 


2. Identify the mission requirements essential for the attainment of 
the desired goals. 


3. Develop alternative system concepts for accomplishing the 
missions. 


4. Establish system evaluation criteria (measures) that relate system 
capabilities to the mission requirements. 

5. Select fixed-cost or fixed-effectiveness approach. 

6. Determine capabilities of the alternative systems in terms of 
evaluation criteria. 


7. Generate systems-versus-criteria array. 
8. Analyze merits of alternative systems. 
[Analyze sensitivity of outcomes to assumptions made]. 


10. Document the rationale, assumptions, and analyses underlying the 
previous nine steps. 


Figure 5.2 illustrates this approach to cost-effectiveness analysis (or 
operations research and systems analysis) and relates it to the planning and 
policy making agency. 

But the imperatives of practice are different from those of formal logic 
and theory formulation. So, although the various steps may be initiated in 
that order, they do not necessarily end in order — there is considerable 
overlap among them, and one stage is often begun before the previous one 
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FIGURE 5.2 
STANDARDIZED APPROACH TO COST-EFFECTIVENESS ANALYSIS 
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has been terminated. In certain situations, the order may be changed 
altogether, with the analysis moving forward iteratively, through a complex 
recycling among the various stages. 


Applications in the Design and Evaluation of Educational Programs 


Two catch-phrases being used with increasing frequency by education 
planners are “program review” and “program evaluation”, synonyms for 
cost-benefit, cost-effectiveness, systems analysis, and so on. But few 
educational programs have yet been subjected to the full range of refined, 
complex, quantitative analyses associated with these techniques. 

Bits and pieces of quantitative approaches to program evaluation have 
found their way into many educational systems. Nevertheless, proceeding 
with the job of systematic analysis of educational programs will require 
attention to all of the elements of the cost-effectiveness method — defining 
objectives more clearly and in more operational terms, devising better 
measures of costs and effectiveness, developing models of educational services, 
and identifying performance criteria. In many respects, the magnitude of 
these tasks is discouraging. Yet the recognition that many educational needs 
are still unmet and that “muddling through”’ is not an acceptable way to 
make decisions in the public sector has greatly strengthened the case of 
advocates of the use of these methods. 

However, all of these things cannot be done at once, and proceeding 
with the job also involves determining a place to start. The most defensible 
starting point is the development of models of the educational system which 
will enable planners to compare the student outcomes of various 
educational programs and units of instruction, to estimate the implications 
of various resource allocation policies, and to identify promising alternatives 
for educational innovation. The reasons underlying this assertion are 
straightforward. First, the model is one of the most crucial elements of 
cost-effectiveness analysis. Second, such models could be used for a wide 
variety of additional purposes. Several such studies are now underway — at 
the Center for the Study of Evaluation of Instruction Programs, U.C.L.A. 
(see, for example, Alkin, 1969) and at the Management Science Center, 
University of Pennsylvania (see Sisson, 1968) in the U. S. Similar work is 
being done in Canada by the Systems Research Group (Judy and Levine, 
1965). 

These studies and many others which could have been cited employ 
models built around five basic components: student inputs, financial inputs, 
external systems, manipulable characteristics, and outcomes. Each of the 
five is discussed briefly below; the treatment closely follows Alkin’s analysis 
(1969). 

1. Student inputs — descriptions or measures of the students being 
introduced into the system. Ideally, the kinds of information that could be 
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utilized would consist of data from achievement, intelligence, and 
personality tests, and documentary material describing students’ homes, 
status in the community, family background, family memberships in other 
social systems, and the like. However, adequate material on student 
characteristics is seldom available and a series of proxy measures, often 
extremely gross, must be developed. 

2. Financial inputs — financial resources. They should be classified in 
several ways: according to the governmental source, according to whether 
the funds are earmarked for specific programs, and according to the 
accounting procedures followed in allocating resources to the educational 
enterprise. Regrettably, many school jurisdictions still use accounting 
procedures which provide data only on functions of expenditures, such as 
administration, instruction, debt charges, and so on, rather than on 
programs of expenditures. 

3. External systems — a web of numerous institutions and 
organizations. Each of these external systems, because they perform 
different functions, places differing sets of demands and constraints upon 
both the educational system and the individuals within it. Consequently, it 
is necessary to identify and quantify the characteristics and activities of 
these external systems which are relevant in terms of their effects on the 
educational system, its inputs, process, and outputs. For example, when the 
analyst is concerned with the effects of external systems on a particular 
school he must look to the characteristics of the community, the 
organization of the school district, the impact of civic government on the 
operation of the school system, the nature of the role of provincial agencies, 
and the activities of voluntary associations within the community. 

4. Manipulable characteristics — characteristics permitting the financial 
input to the system to be utilized in a number of ways. The student-teacher 
ratio can be increased or decreased, standards can be established which 
insure the hiring of teachers with specified characteristics, salary policies can 
be varied, different administrative arrangements can be developed, different 
curricula and instructional procedures can be introduced, and the effects of 
instructional technologies can be examined. 

5. Outcomes — two main elements form the set of outcomes which 
round out the model: student outcomes and non-student outcomes. Student 
outcomes are measured in part by academic achievement tests, but other 
aspects, such as changes in student behavior, the success of students in their 
future vocational and educational endeavors, and student impact on 
external systems, also need attention. Most of the questions about the 
measurement of student outcomes have yet to be answered; obviously, these 
problems can be solved only through extensive research. 

Non-student outputs refer to the extent and kind of effects that 
decisions taken in the educational system have on its organization set. They 
include, for example, the extent to which the number and salaries of 
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teachers and non-professional school personnel modify the community, the 
impact on the community economy of large capital investments or supplies 
purchased locally, school transportation arrangements, and scheduling of 
student time which has a bearing on parental employment. 

Potentially, such a model can be applied to at least three classes of 
problems. The first concerns the evaluation of resource allocations at the 
margin. If student inputs and external systems are held constant 
statistically, the change in outcomes on each of a number of dimensions 
attributable to successive dollar increases in financial input might be 
estimated. Second, cost-effectiveness procedures provide a vehicle for 
comparing actual with predicted performance, and, in the process, for 
identifying the uncontrolled characteristics of a situation which can lead to 
either lower or higher levels of performance than expected. Finally, the 
method can be used to outline improved ways of doing a given job, 
including shortening the time required to meet program objectives, 
increasing the quality and quantity of products, and reducing both unit and 
total costs of the delivery of services. 


Summary Comments 


Cost-effectiveness analysis offers a way to choose the numerical 
quantities related to educational programs so that they are logically 
consistent with each other, with a given objective, and with the analysts’ 
expectations for the future. The method provides its solutions by processes 
that can be critically examined, duplicated by others, and, more or less, 
readily modified as new information becomes available. 

Still, this form of analysis has three limitations which confine its role to 
that of an advisory tool. Analysis is necessarily uncomplete — time and 
money costs limit the extent of inquiry, and analysis can never treat all the 
considerations that may be relevant. Measures of effectiveness are inevitably 
approximate, never absolute. And no wholly satisfactory way to predict the 
future exists. 


Input-Output Analvsis 


Input-output analysis is concerned with the structure of systems, with 
the ways in which the parts fit together and affect each other. It is, above 
all, an analytic tool and, like cost-benefit and cost-effectiveness analysis, has 
come to be primarily a branch of econometrics. It provides a means for 
describing and analyzing the structure of the educational system from 
kindergartens through all forms of post-secondary education and the 
relationships between the educational system and government, the other 
social services, and the economy. On the descriptive side the input-output 
table permits the identification of many forms of educational activity and 
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their relationships with other agencies. On the analytic side, it provides a 
quantitative model of educational processes and can provide a quantitative 
basis for decision making. 

The origins of contemporary work in this area can be traced directly to 
Leontief’s studies of production based on the idea of economic 
interdependence. Input-output analysis, as a method of relating production, 
payments, and demand, became the empirical basis of his theory. 


Input-Output Analysis in Economics 


In economics, the basis of the analysis is the input-output table, or 
table of economic transactions, which shows how the output of one 
industry is distributed among other industries and the whole economy, and 
how one industry draws its resources from other parts of the economic 
system. The table describes the existing supply and demand relationships in 
an economy. Even if it could not be used for any other purpose, it would be 
useful to policy makers and planners, but the range of possible applications 
is almost limitless. In addition to supplying basic facts about the structure 
of an economy, it can be used for short- and long-term forecasting, for 
interregional and international comparisons, to identify determinants of 
supply and demand, to isolate the repercussions throughout the system 
from a change in one element of the economy, and as a guide for economic 
development and programming. 

The input-output table is made up of four sectors (Miernyk, 1965): 

1. the processing sector, containing industries producing goods and 
Services; 

2. the payments sector, identifying payments for the factors of 
production, including payments to other industries for imports, to 
government for services and taxes, and to households; 

3. the final demand sector, showing the final destinations or consumers 
of industrial output; 

4. total gross output and total gross outlay, the summary measures of 
all economic transactions which accumulate the value added to a good or 
service at each stage of the production process until it reaches its final 
consumer. 

Obviously, the dimensions of the table depend on the purposes of the 
analysis, and the degree of disaggregation desired. If it is to be used for 
forecasting supply and demand for specific products, a great deal of detail 
will be required. In other cases, it will be more useful to consolidate discrete 
industries into much larger groupings. So, for example, if the education 
industry is to be incorporated into the analysis, various institutions, like 
universities, colleges, and vocational institutions, can be handled separately 
or placed into clusters or even a single category. In general, however, 
analysts strive for the maximum feasible disaggregation. 
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Once the table has been constructed and the dollar value of transactions 
recorded, the idea of interdependence can be expressed quantitatively by 
the technical coefficient, the value of inputs required from each industry to 
produce a dollar’s worth of output from a given industry. It is clear that an 
industry cannot pay more for its inputs that it receives from its outputs. 


Applications in Education 


The first attempt to apply input-output analysis to education was made 
by Mort and others in 1946, ten to fifteen years after the work of Leontief. 
Mort’s work was followed twelve years later by the exploratory study of 
Kershaw and McKean (1958) which has now become the most often cited 
analysis of input-output relationships in education. 

The central focus of educational studies has been on (1) the association 
between student achievement and school or community characteristics and 
(2) the capacity of educational systems to raise the achievement levels of 
students. Two methods have dominated studies of these determinants of 
performance: cross-sectional studies using analysis of covariance and 
multiple correlation to estimate the association between differences in 
achievement and variations in educational inputs, and longitudinal studies 
examining the response of students to changes in school programs and 
services. 

The examination of input-output relationships in education has been, 
and probably will continue to be, fraught with difficulties. Large scale 
analysis is required to reduce the effects of random disturbances. Kershaw 
and McKean (1958), for example, point out that if eight input variables, 
each with two levels, are examined, the number of input-output 
combinations is 256 (28) and, consequently, “doubt if a very helpful 
analysis could be made with a sample that comprised less than 500 schools 
(p. 17). There are conceptual or modelling problems as well — What will be 
the predictors? The criterion variables? The covariates? How will criterion 
levels be defined if the analyst wishes to identify the effects of increments 
of cost? Third, there is the problem of interpreting the results. Some 
covariates or control variables, like student ability, may be more important 
than predictor-variables in influencing output. And, finally, even the best 
available data may be inadequate for the purposes of the analysis and next 
to useless for answering the critical economic question of estimating output 
for each increment of input. 

In spite of these difficulties, research into the determinants of student 
achievement has made rapid strides forward in the last ten years. In the first 
place, certain early assumptions about input-output relations in education 
systems have been challenged and proven false (Lyle, 1967). So went the 
idea that per pupil expenditure is the key determinant of achievement — it 
is now recognized that other factors account for more variance. Second, 
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contemporary analyses are less simplistic than their forerunners: attention 
to the mix of services, not single-minded concentration on a given variable, 
has proven to be the more fruitful approach to analyzing the input-output 
relationships in education. Finally, analysts have learned to ask more 
important questions — what factors are associated with increased student 
achievement and attention? — instead of what factors determine educational 
expenditures? A review of these developments and of the increasingly 
substantial number of inferences about achievement determinants in 
educational systems has been made by Lyle (1967). 


Summary Comments 


Input-output analysis offers education planners a quantitative 
procedure for examining and understanding interactions between 
educational systems and governments, students and school staff, school and 
community, and students and their peers. To be sure, no quantitative 
analysis can describe these interactions in a fully satisfactory way, but it can 
provide the policy maker and planner with a basic appreciation of the 
structural linkages among the components of the educational system. And it 
promises to provide a basis for integrating the manpower requirements, 
social demand, and educational supply approaches to education planning, 
approaches which have been kept artificially discrete by their advocates for 
too long. 


Planning, Programming and Budgeting (PPBS) in Education 


The budget, a basic instrument of policy makers and administrators, is 
the principal means through which educational plans are operationalized 
and expressed in concrete terms. Perhaps because this statement is so 
obvious, its full significance is often lost in practice. In the real world, the 
budgetary process bears little resemblance to the rational planning process 
described in this chapter. Budgeting has been a political process, subject to 
power struggles, and not designed to help in planning and policy making. In 
fact, one of the first departures from rationality in the planning process is 
likely to come at the time when budgets are prepared and debated. 

Therefore, improving the budgetary process is critical to improving 
policy making and planning. This is not to suggest that budgets should not 
be subject to political scrutiny and approval. Rather, it implics that budgets 
should reflect planned objectives and the means for attaining them. 

Attempts to improve the budgetary process are not new. Schick (1966, 
pp. 243-58) has traced budgetary reform in the United States through three 
distinct stages: central control, scientific management, and PPBS. Program 
budgeting proposals began appearing from RAND in the early 1950’s and 
the procedure was first implemented in the early 1960’s in the US. 
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Department of Defense under Secretary McNamara. The conceptual basis of 
this economic model can be traced to developments within the science of 
economics (particularly in microeconomics and principles of marginal 
analysis) and to a desire to combine policy with budgeting. Much of the 
impetus of the movement toward PPBS is based on the recognition of the 
growing contribution of the systems sciences to administration. 

The RAND Corporation has been and continues to be one of the most 
influential agencies in the development of program budgeting. As early as 
1954, Novick wrote a RAND monograph in which he defined a program as 
the end objective of an agency that is developed or budgeted in terms of all 
the elements necessary to its execution. RAND in fact was instrumental in 
refining PPBS and in aiding its adoption by the United States government. 
Numerous papers and memoranda have been prepared by RAND on the 
allied topics of PPBS, systems analysis, and cost-effectiveness; several are 
worthy of close attention (Novick, 1961 and Fisher, 1964). 

Although there is at present no generally accepted definition of 
program budgeting, it is usually described as a planning-oriented procedure. 
Its chief goal is to integrate planning (defined as setting policies and 
objectives), programming (identifying what must be done to achieve the 
objectives), and budgeting (a time-phased allocation of resources to 
program). In much the same vein, Schick (1956, p. 251) described PPB asa 
way to rationalize policy making by providing (a) data on the costs and 
benefits of alternative ways of attaining proposed public objectives, and 
(b) output criteria to facilitate the effective attainment of chosen objectives 
and the measurement of performance. 

It is usual for both programs and resources to be projected for at least 
several years into the future. Emphasis is on outputs, cost-effectiveness 
methods, rational planning techniques, long-range objectives, and analytical 
tools for decision-making. Hartley (1968) considers that the essential 
feature of PPBS is the projection of total resource and dollar needs for a 
suitable number of years and in relation to key decision variables of the 
organization. 

Hartley also outlines what PPB is not: 


To begin, the word program does not refer to computer 
programming; it does relate to the activities of an organization that 
are based on desired outcomes. Second, program budgeting is not 
merely a new label for old notions such as performance budgeting 
or functional finance, where the functions were usually expressed 
in line-item, object classifications. Third, this conceptual approach 
to budgeting is not simply another cost restraint device that 
sacrifices goal accomplishment for minimum cost considerations. 
Fourth, it does not imply that the entire output of an organization 
can be quantified and measured. Fifth, the program budget is 
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neither a substitute for good management nor a remedy for 
organizations who do not have sufficient resources to achieve their 
objectives (1968, p. 75) 


Characteristics of PPBS 


The central feature of PPBS is the attitude it conveys about the 
budgeting process and the development of plans based on considerations of 
outputs per unit of input, of rational compromises in allocating resources 
among competing objectives, and of the phasing of program activities over 
an extended period of time. 

Program budgeting has six characteristics which distinguish it from 
traditional, line-item approaches to allocating resources: 

1. Analytic features — systems analysis is used to examine alternative 
courses of action in terms of their expected utility, cost, sensitivity to 
changes in evaluative criteria, and responsiveness to assumed environmental 
changes. When possible, a quantitative analysis of comparative benefit or 
effectiveness is made. Otherwise, less rigorous analysis prevails. 

2. Planning — the iterative process of making policy decisions based on 
means-end considerations that culminates in a particular budget and 
multiyear projections. 

3. Programming — the planned goals are related to specified alternative 
programs. Inputs are related to outputs by lines of action that reflect 
immediate, intermediate, and long-range objectives. 

4. Budgeting — Instead of showing budget dollars by an 
object-of-expenditure classification, PPBS is designed to relate programs to 
resources that are then transformed into dollar estimates for present and 
future years. As the nucleus of PPBS, the program budget expresses dollar 
allocations in relation to the outputs or programs. 

5. Structural features — an essential characteristic of PPBS is its output 
orientation. Each agency is required to determine a series of output 
categories that cover its total work. This set of output-oriented activities 
serves as the basic framework for the planning, programming, and budgeting 
process. 

6. Administrative features — as an executive tool, PPBS is designed to 
facilitate the kind of information analysis that provides administrators with 
a basis for rational choice. It prescribes structures for organizing programs 
but, at the same time, allows much variation in the administration, 
enforcement, and revision of resource allocation decisions. From = an 
adminstrator’s point of view, PPBS offers at least four important advantages 
over traditional practices: (a) information on total system costs is program 
or output oriented; (b) analysis of possible alternative programs and 
alternative means of meeting program objectives is more extensive; (c) the 
planning process is continuous, and includes multiyear plans so that future 
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implications of present decisions are explicitly identified; and 
(d) policy-making is an ordered, well-defined process which directs major 
lines of action toward perceptible goals. 

In education, the PPBS process is cyclical, moving among seven 
analytically, although not always practically, distinct stages: (a) the setting 
of objectives based upon cultural values, social concerns, and resources at 
hand; (b) the selection of programs from available alternatives to enable the 
attainment of objectives given certain program costs; (c) the implementation 
of selected programs; (d) the translation of programs into long-range 
financial plans; (e) the striking of an annual budget to allocate resources to 
the selected programs; (f) the evaluation of program outputs; and 
(g) periodic review and revision of the service offered. 


Limitations of Program Budgeting 


Since program budgeting is a form of system analysis (and since it relies 
heavily on a form of cost-utility analysis), the conditions that limit its use 
have been covered largely in previous sections of this chapter. In summary, 
however, a number of problems in applying PPB to education bear 
mentioning again: 

1. The difficulty of defining the “educational system’s objectives in 
terms of the development of specified types of learners, up to stated levels 
of competence, in narrowly or comprehensively defined concepts, skills, 
understandings, and appreciation (Knezevich, 1970, p.91)” is an 
overwhelming task and one that has yet to be accomplished. 

2. The problem of translating objectives into educational programs and 
determining just what categories constitute the most useful programs and 
program elements is clearly obvious. 

3. The location of all pertinent data will require the development of 
expensive information retrieval systems. 

4. Long-term costs and benefits are difficult to compute accurately, 
especially when compared to costs and benefits at a specific point in time. 

5S. Wildavsky (1966) contends that, as it is presently conceived, 
program budgeting contains an extreme centralizing bias which runs directly 
counter to the professional expectations of educators. The top executive 
assumes increasing power in relation to his subordinates as the ultimate 
control over the budget is centralized. 

6. Program budgeting’s emphasis on long-range planning (usually five 
years) has the effect of committing the organization to certain expenditures 
over an extended period of time. This limits to some extent the flexibility 
of future planning and leaves a narrow zone for adopting changes within the 
budgeting structure. 

7. The costs in terms of time, money, and effort of adopting a full 
program budgeting system in school systems often becomes prohibitive 
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when weighed against the benefits to be obtained. The process should not 
be blindly accepted as a readily usable panacea for financial and budgeting 
difficulties. 


Concluding Notes: Some Management Issues 


One way of describing the end products of cost-benefit analysis, 
cost-effectiveness analysis, input-output analysis, and program budgeting is 
prediction based on analysis. Of course, the validity of predictions made in 
the analysis processes outlined is subject to the inescapable uncertainty of 
the analyst’s conception of the future, the adequacy of his present 
measures, and his expertise at estimating the intangibles within the scope of 
his analysis. 

Still, the decision-maker can make use of the products of such analyses 
to improve his quality of decision-making. While it is recognized that 
decisions are made on the bases of intuition, experience, and judgement, the 
financial and economic information provided by the analytic processes 
previously described provide more information about the potential 
alternatives being considered. 

The application of these techniques to planning problems will have 
repercussions throughout the educational system, particularly on the 
distribution of decision-making power and on jurisdictional claims within it. 
Their centralizing bias has already been noted. And they tend to enhance 
the power of parts of the education system which have previously been 
regarded as unimportant — the housekeepers of the organization’s 
information system, for example. 

There are four or five major obstacles to the use of these procedures for 
quantitative decision analysis within educational systems. In the first place, 
the four methods are aimed at rationalizing decision making procedures and 
often used to resolve public issues. Both of these conditions imply a shift 
away from the comforts of routinized decision procedures which will be 
resisted. 

There are two other ways in which the use of these techniques upsets 
traditional procedures. They tend to depersonalize decision making in the 
sense that they leave decisions more open to scrutiny and debate. More than 
this, they require the merging of a new decision making structure with 
established budgetary procedures, both within public agencies, and between 
PPB inside the agencies and the legislative review and appropriations 
procedures outside of them. 

One of the critical stages in the PPB cycle is the development of 
measures of effectiveness and their use in program evaluation. In the past, 
educators have not done a very good job of evaluating their programs, and 
one cannot help but wonder how evaluative criteria will be developed and 
what will be the result. Some early output measures, such as those involving 
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simple body counts of people receiving services have been next to useless. 
But there have also been a number of creative and imaginative attempts to 
develop more meaningful output measures, and it is on such efforts that the 
eventual contribution of PPB to education planning depends. 

By way of conclusion, then, it seems that these quantitative decision 
analysis tools have been the exclusive stock in trade of econometricians for 
too long. The most pressing problems surrounding their use in education are 
social and psychological in nature, and the time has come for other social 
scientists to give these problems the attention they deserve. Without it, the 
incorporation of these procedures into the planning process will be much 
more difficult than it needs to be or, worse yet, they will not be used at all. 
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CHAPTER SIX 


LINKING EDUCATION PLANNING AND SOCIAL FORECASTING 


I hold that man is in the right who is most in league with the 


future. 
Henrik Ibsen 


As the pace of social change has quickened and become more turbulent, 
shortening the time available for response and often aggravating 
long-standing educational concerns, it has become more apparent that better 
social forecasting, at least of the main problems, is essential if the tendency 
to plan education in an ad hoc manner is to be overcome. This conclusion is 
neither new nor startling. It is really a rewording of the old saw about 
planning — although everybody forecasts, few do it very well, and now the 
time has come to do a better job. 


There is at least one novel element in recent expressions of this notion — 
newly devised methodological and conceptual tools for systematic forecasting 
of the future now promise to make the link between systematic 
forecasting and planning a vital one. Properly done, forecasting can identify 
likely problems and encourage thinking about corrective action; by 
outlining the nature and magnitude of social, economic, and technological 
changes, forecasts can help the policy maker set his priorities for 
intervention into the present system; if predictions are based on a clear 
understanding of the constraints which effect educational programs, they 
can help planners develop realistic courses of action; and they provide one 
framework within which the planner might conduct an a priori evaluation of 
the effectiveness of alternative courses of action. 


Social forecasting, a very ancient art, is only in its infancy (some of its 
critics would suggest that its state is embryonic at best) in its development 
toward becoming a science. Thus, even though the techniques of social 
forecasting seem promising, planners should not accept their results 
implicitly. There are good reasons for caution. Some writers wonder 
whether social forecasting provides an image of the future at all — to the 
contrary, O.D. Duncan (1969) suggests that most social forecasts provide a 
rhetorical stance for the discussion of simple extrapolations and 
magnifications of current concerns. Forecasts seldom, if ever, capture the 
dynamism of social events. Futurologists, like other analysts, must walk a 
tightrope between useful generalization and detailed description, but they 
fall off more frequently than do their colleagues in the established social 
sciences. A third reason for caution is that forecasts, in addition to serving 
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to stimulate the planner’s thinking, can also lead to reactions in the system 
about which the forecasts have been made — the popular debate in the 
U.S.A. about the self-fulfilling nature of forecasts concerning campus unrest 
and riots in the streets is probably the most ready example of this 
phenomenon (Fisher and Lowenstein, 1967). Fourth, some forecasts are 
hard to distinguish from sheer speculation, even after extensive critical 
discussion, and must be treated as such. Finally, there are always present 
questions of the forecaster’s assumptions about historical development, the 
nature of cause and effect, and social values. A nice illustration of this last 
caution is a report! about a series of Delphi forecasts of society in the year 
1980 made by a group of American business executives in the late 1960’s — 
forecasts describing steady economic growth, social stability, and 
technological progress. One cannot help but wonder how city slum-dwellers, 
because of different assumptions, different ideas about cause and effect, and 
different values, would have responded to such an assignment! 

Erich Jantsch (1969, p. 441) places the possibilities for linking social 
forecasting and planning in perspective: 


The intellectual games played today with possible and 
desirable futures have little to do with planning and design leading 
to real action. The sudden recognition that it may become possible 
to shape the future actively, and the lack of understanding of 
evolutionary processes — which are characterized by the complex 
system dynamics — led to some sort of intoxication with 
unrestrained freedom and even anarchy, and to blindness towards 
the growing complexity of the systems of human living which, in 
turn, makes the tasks of planning and design so much more 
complex. We may now begin to discard these naive attempts to 
dream up or extrapolate the future. We are led to a profound 
concern about the basic structures and boundaries of systems 
whose uncontrolled development we have to get into our hands 
before we may allow ourselves some extravagance. Here is a basis 
of rationality for setting priorities, planning, and making decisions 
—a basis for exerting human freedom in a responsible way. 


In this chapter social forecasting and its connection with education 
planning is discussed, not as it is (the discussion would be very brief indeed), 
but as it might be. The next section is an inventory of methods for 
prediction. The final sections are given over to the development of a model 
for social forecasting and a discussion of some general guidelines for linking 
social forecasting and the education planning process. 


| Unfortunately I have lost the citation. 
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Approaches to Social Forecasting 


While playing a hunch will always have its place in education planning, 
the planner can hardly rely on it as a regular procedure. For this reason a 
variety of methods to forecast the future are being systematically devised. 

Although no rigorous classification of methods and no guidelines for 
matching methods and problems have yet been produced, much important 
work has been done. Jantsch (1966), for example, has analyzed approaches 
to forecasting in terms of a distinction between two basic uses of forecasts: 
exploratory forecasting, an attempt to project futures with a view to 
estimating what is likely to happen if present trends continue and what is 
possible, given various interventions into the system; and normative 
forecasting, which involves working back from the stipulation of a set or 
alternative of social goals for the future and determining what actions will 
be required to attain these goals. A third category should be added to 
Jantsch’s classification — descriptive forecasting, which -has to do with an 
understanding of current commitments and expectations. This latter 
category, then, includes that knowledge of the future which is the minimum 
requirement for organized planning. 

Another writer, O.D. Duncan (1969), although much more critical of 
recent forecasting efforts than Jantsch, has identified two particularly 
promising points of departure from which the problem of the future might 
be approached and which might lead to better analysis of social conditions 
as well. 

The first is the idea of the cohort as it might apply to the longitudinal 
analysis of social change. The notion of the cohort is a powerful one for the 
analysis (and ultimately the forecasting) of social change. A cohort is the 
ageregate of all persons experiencing an event which can be used to define 
membership — the birth cohort for a given year is a common example. If 
cohorts are studied over time, if comparisons are made between and within 
cohorts, and if their response to definable social changes are examined, 
clearly the basis of understanding social phenomena and their effects will be 
strengthened. Consider, for example, a 1945 birth cohort (made up of all 
persons born in 1945 in the area under study) and trace some of the more 
significant social forces and other developments which have shaped the lives 
of its members — television, the easy affluence and expansion of the 1950’s, 
the assassination of public officials, space travel, and moon walks. Then, 
compare that cohort to an earlier one, the 1910 birth cohort, for instance. 
How different were some of the experiences of the 1910 cohort — the 
Twenties, the crash of the stock market, the Great Depression, World War 
II, and so on. This example, while in some respects a glib one, does make 
the point. Both the understanding of social change and social forecasting 
can be strengthened by taking advantage of cohort analysis and inter- and 
intra- cohort comparisons. 
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Duncan terms the other point of departure the ecological approach to 
examining social change and devising social forecasts. Essentially, it requires 
the forecaster to account for interactions among population processes, 
changes in environment, technological developments, and new social 
Organization and not to treat them as independent or as if they can be 
forecast in isolation from each other. Both approaches are grounded in his 
conviction that speculation about the future is no substitute for sound 
analysis and that “useful forecasts issue from good analysis. . . the results of 
good analysis can always be given an orientation toward the future. (p. 
112).” 

Bell’s treatment of approaches to forecasting (1964) remains one of the 
more stimulating discussions of the topic and his lead will be followed here. 
However, before outlining some of his twelve modes of prediction, his own 
disclaimer needs to be emphasized: 


The sorting is an effort to illustrate the range of approaches in the 
art of conjecture. The different modes are not “equal” to each 
other in the level of generality or scope of comprehension. 
Inevitably there are some overlaps, and a stricture reading might 
show that one mode subsumes some of the others (p. 847). 


In short, no logical classification of methods and no explicit tramework for 
matching problems with methods have yet been devised. 


Prediction Based on Analysis: Some Early Forms 


Of Bell’s twelve modes of prediction (in some cases, the word 
conjecture would be better because of its connotation of less rigor), nine are 
representative of most early approaches to social forecasting. Generally 
speaking, the nine have fallen into disfavor with professional futurists 
(perhaps because they are overly anxious to develop their own, newer 
techniques) and are seldom considered in the literature. The nine are the 
approaches to prediction which dominate practice, however, and this, in 
itself, is a good enough reason to mention them here. There is a more basic 
reason for outlining them: at this early stage in futurology’s development 
toward a science, there is no evidence that the newer modes of prediction 
will yield better forecasts than will the nine outlined below. Parenthetically, 
it is worth noting that intuition or playing a hunch can lead to better results 
in some situations than any form of prediction based upon analysis. 

1. Social laws. Although few serious social scientists today believe that 
a comprehensive set of social laws, based on a few crucial variables used to 
describe regularities in human behaviour, is in prospect, some formulations, 
like Marx’s laws of capitalism, have had a pervasive impact on planning. 
Other formulations, although less ideological in character, have also 
influenced planning: consider the implicit law of exponential growth in the 
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often used statement of education planners, “We expect enrolment to 
double within x years, and every y years after that.”’ While it is usually easy 
to take exception to such propositions on analytic grounds, it is harder to 
deny their power in motivating and communicating with the public about 
prospective social action. 

2. Trend analysis. A more common approach to prediction than the 
quest for some general principle involves extrapolations from observed 
time-series data to provide forecasts of economic growth and demographic 
change. These forms of prediction are also the furthest advanced 
methodologically, though they are rarely able to pinpoint social changes 
over time, and their methods and assumptions are open to scrutiny and 
debate, an important condition which does not hold for all modes of 
prediction. Generally, trend extrapolation is the most powerful means of 
predicting economic and demographic events in the short run. It is less 
accurate as the time horizon of the forecast becomes more distant, and as 
the number of principal interactions becomes too large or complex. 

3. Structural certainties. Customs, constitutions, and laws, to the 
extent that they remain constant or at least are slow to change, help the 
planner mark many of the contours of possible future social action (de 
Jouvenal, 1967). Take, for example, Canada’s constitutional provisions for 
education, vesting control with the provinces with provisos safeguarding the 
rights of religious minorities as they exist at the time of union. Of course, 
such constraints can be reviewed and even tested in the courts, but broadly 
speaking, they must be treated as givens, both for the present and the 
future. | 

4. The operational code. Analogous to these structural certainties, but 
without legal or moral sanctions to enforce them, are the implicit codes of 
conduct which seem to influence behavior in organizations and to define an 
organization’s characteristic way of responding to external events. The 
notion of organizational style is necessarily vague. (What, for example, is red 
tape?) Further, efforts to characterize it usually result in stereotypes and so 
they should not be applied to individual cases automatically or 
mechanically. But, to the extent that they identify characteristic ways of 
handling problems they “‘can serve as a rough guide to political action.” 
(Bell, 1964, p. 856). 

5. The operational system. Continuity in social systems is achieved in 
part through the power structures within the systems, how they operate, 
how they rejuvenate themselves. In most cases, systems can tolerate changes 
in office-holders — the persistence of democratic government, in spite of 
more or less regular changes in incumbent policy makers, is a case in point. 
In this sense, at least, it is important for the planner to differentiate 
between structural sources of power and “‘who” has power at a given 
moment, and to plan for the political aspects of the future with this 
distinction in mind. Of course, the planner’s task is complicated by the facts 
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that many of these operational modes of power coexist, and that the 
balance among them shifts over time. Nevertheless, an awareness of them 
and their social effects is a precondition for political prediction. 

6. Structural requisites. Political and social theorists have from time to 
time identified a number of basic requisites common to all forms of social 
organization. Talcott Parsons (1960), for example, describes the four 
imperatives of any society as adaptation, integration, goal achievement, and 
pattern maintenance. Proponents of general systems theory write about 
these conditions for continuous social organization in terms like 
“homeostasis” and “negative entropy”. As they stand, few of these 
theoretical formulations offer the planner working in the real world very 
much guidance. But, if the planner thinks of them as countervailing forces, 
that is, as constraints placing limits on the range of possible action, they can 
take on more significance. 

7. The overriding problem, Policy analysis and development is often 
cast in terms of a concern for a single, overriding social problem. In Canada 
we have seen many variants of this — the concern for national identity 
which has been a recurring political theme in the last one hundred years, the 
growing apprehension over the effects of environmental pollution, and the 
war on inflation. To be sure, the idea that one concern can dominate public 
affairs is simple-minded and not empirically supportable. But, like the 
operational code, an awareness of the dominant concerns in a society 
provides a rough and ready guide to the planner in predicting what will have 
public appeal and what will not, which interventions will be acceptable and 
which will be resisted. So, for example, the curriculum planner who talks 
about “‘relevance” will have a ready audience, at least among students, while 
his colleague who describes his work in terms like ‘‘the structure of the 
discipline’ and “order in the classroom” is not likely to be received with as 
much enthusiasm. 

8. The prime mover. From time to time, social commentators have 
assigned special importance to certain variables as major determinants of 
social behavior. Marx, for example, viewed the means of production as an 
independent variable and predicted a number of secondary social changes 
which would follow from changes in this special factor. To take an 
educational example, how many recent changes in curricula have been 
attributed to the Soviet Sputnik launched in 1956? Similarly, how many 
current statements about educational opportunity can be traced to the 
assumption that social mobility is the major determinant of the open, 
democratic society? 

9. Sequential development. Social philosophers since Plato have been 
prone to describe social growth as an evolutionary process moving through 
definable stages from a simple, or primitive, condition to a complex, or 
modern, state. Although such views of social and political change are no 
longer thought to be theoretically sound when expressed without 
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qualification, nevertheless most discussions of social and economic 
development and political modernization suggest that there is some 
agreement that societies do change in an orderly, somewhat predictable, 
way. While, at first glance, these ideas may seem most applicable to planning 
in the “developing” and “‘underdeveloped”’ nations, they also have some 
relevance to the planner in the modern state, both as a way of 
understanding the history and structural requisites of his situation and, after 
a comparison of his situation with practices in more advanced regions, as a 
way of foreseeing what might happen within his jurisdiction. 


Some Recent Developments: Social Accounting and Systematic Futurology 


Recent attempts to develop more rigorous approaches to forecasting 
than the nine listed above can be placed into two categories. The first 
involves using a system of social accounting for predictive as well as for 
descriptive-evaluative purposes. The discussion of social indicators in 
Chapter Three concentrates on descriptive social reporting and assessing 
social progress along a number of dimensions, largely through the use of 
time-series data. Clearly, such observed trends could be used for the 
projection of alternative futures and ultimately, perhaps, for the 
construction of models of the primary interactions within a system which 
can be used to identify the impact of alternative interventions into the 
system. 

The second category which, for lack of a better term, might be called 
systematic futurology, involves attempts to discover objective and scientific 
ways for exploring the future and to link it with planning and policy 
making. Initial work in this area has received its impetus from the 
realization that significant social changes have come about as the result of 
technological developments, and that, to the extent that the direction and 
pace of technological innovation can be anticipated and controlled, it will 
be possible to forecast and control social progress. But this was only a 
beginning. Contemporary social forecasting is concerned with much more 
than the connection between technology and society. It is used to provide 
information about the kinds of future development that are likely, that are 
possible, that are desirable, and the amount of effort that will be required to 
accomplish them. In this sense, it is a way of describing the range of possible 
or alternative futures before a society and of influencing the direction and 
pace of development. 

The techniques now being introduced into social forecasting were first 
developed and applied to technology and the physical sciences. This is, of 
course, understandable, for there the problems can be clearer. In Jantsch’s 
survey of technological forecasting, published by OECD in 1966, some 
twenty basic approaches were listed; the possibilities for devising hybrid or 
modified methods are almost unlimited. Only those which seem to be most 
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important for forecasting social development will be outlined here. 
However, it seems necessary to repeat again the caveat that by now will be 
familiar to the reader — these techniques are designed to augment human 
thinking and judgement, not to replace them. 

The Delphi technique, perhaps the best known and most widely 
discussed of the new methods of forecasting, was developed by Dalkey and 
Helmer (1963) of the RAND Corporation. Essentially a refinement of 
“brainstorming”, the Delphi technique aims at sharpening forecasts by 
seeking agreement within a group of experts on a step-by-step basis. The 
technique has been applied to forecasting the estimated time of scientific 
and technological breakthroughs, to the problems of defense and the 
exploration of outer space, and, increasingly, to the prediction of social 
futures. The greatest contribution of Delphi studies is likely to be in this 
latter area, where intuitive thinking is valuable and where consensus is 
important, as in the formulation of social goals. 

A second approach, scenario writing, used extensively by Herman Kahn 
and his colleagues at the Hudson Institute, involves setting up a logical but 
hypothetical sequence of events to show how a system might move from 
some beginning to an end point (Kahn and Weiner, 1967). Its main purpose, 
then, is not to predict the future. Rather, it focuses on outlining the steps 
through which some hypothetical situation can be reached, and identifying 
some of the critical choice points in the evolutionary process. 

Another goal-oriented approach to forecasting is the normative 
relevance tree technique (Jantsch, 1966). Starting with goals and objectives, 
the technique traces through the elements of a solution down to the point 
where existing technology and knowledge can be evaluated in terms of their 
relevance to a given problem. The forecaster is then in a position to identify 
scientific, technological, and social obstacles between the present and the 
hoped-for future, to design programs to surmount the obstacles, and to set 
priorities among the various programs. 

Most forecasting systems are limited by their inability to consider fully 
the interactions among predicted events — events are forecast discretely as if 
they were unrelated to other events. The final method of prediction to be 
described here, the cross impact matrix method of forecasting, aims at 
overcoming this deficiency. Although its developers, Gordon and Hayward 
(1968), have tied it to forecasts obtained through Delphi procedures in their 
initial experiments, there is no compelling reason to do so, for the method 
has much wider applicability. 

The rationale of this procedure is straightforward. Social events are 
often related and have a (cross) impact on each other, which can be 
described in terms of three linkage concepts — enhancing, inhibiting, or 
unrelated. While these concepts provide only the rudiments of a general 
theory of cross impacts, this work is among the most promising efforts in 
systematic futurology. 
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It is clear that results obtained using this procedure (in some respects, a 
quantitatively devised, internally consistent silhouette of the future) are 
artifacts of the model, the events which are interrelated, and the 
probabilities of occurence initially assigned to the predicted events. 
Nevertheless, as a systematic way of collating forecasts it offers certain 
important advantages to the planner: (a) it can be used to determine the 
effects of alternative policies; (b) it has theoretical value:in that it can help 
the analyst improve his understandings and assumptions about social 
causality, and (c) it can identify connections among events that might not 
be apparent otherwise. 

A more complete discussion of these and other methods of forecasting 
can be found in Jantsch (1966). The following table summarizes Jantsch’s 
study and, importantly, attempts to match methods with purpose (1966, 
pp. 125-126): 


A Preliminary Framework for a Social Forecasting System? 


Studies of the future proceed inescapably on assumptions about 
historical development, the direction of cause and effect relationships, and 
the organic nature of society. These assumptions can be spelled out before a 
forecasting system is modelled, or they can be put forward in the modelling 
process in the light of the quality of the best available data. They can be 
taken as simple givens, or they can be tested analytically and revised when 
needed. 

The approach to forecasting outlined below is based on two premises: 

1. Because of the imprecise character of the “science” of forecasting 
and the absence of guidelines for achieving a fit between purpose and 
method, any current attempts at social forecasting should be eclectic, 
drawing from whatever methods seem appropriate in the situation. So, for 
example, the starting point taken here involves six domains in the study of 
society: social life and institutions, population processes, government 
policies, economic development, industry and technology, and physical 
resources. These are, of course, interconnected in a complex way — 
everything is related to everything else. When applying the model, the 
nature and directions of these relationships will have to be made explicit 
and reduced to managable proportions. It seems appropriate to do this on a 
situational basis, by whatever means appear reasonable — by linear 
estimation procedures such as regression analysis, factor analysis, or 
canonical correlation, by _ historical analysis, even through — such 
“disreputable” procedures as Bell’s prime mover. 


2Many of these ideas have been borrowed from L. W. Downey’s “‘The Role of 
Research in the Commission on Educational Planning.” 


103 


LINKING PLANNING AND SOCIAL FORECASTING 


Table 6.1 


A SUMMARY OF FORECASTING METHODS 


QUESTION 


1. Scientific 


breakthroughs 


2. Technological 


breakthroughs 


3. Areas of fundamental 


research and explor- 
atory development 
to be favoured. 


Nature of techno- 
logical innovation. 


. Technological per- 


formance (Technical 
parameters, func- 
tional capability, 
e1C.): 


Development time. 


. Development costs. 


. Return on 


investment. 


. Production costs. 


. Maintenance costs. 


APPLICABLE TECHNIQUE 


Trend (envelope curve) 
extrapolation? 

Morphological research. 

Relevance tree. 


Trend (envelope curve) 
evaluation. 

Contextual mapping. 

Morphological research. 

Economic analysis. 

Horizontal decision matrix. 

Vertical decision matrix. 

Simple operations research. 

Simple decision theory. 

Relevance tree. 

Normative operational 
models. 

Systems analysis. 


Brainstorming. 
“Delphi” technique. 
Morphological research. 


Trend extrapolation 
(analytical). 

Trend extrapolation 
(phenomenological). 

Contextual mapping. 

Morphological research. 


Systems analysis. 


“Delphi” technique. 

Trend extrapolation 
(analytical). 

Trend extrapolation 

' (phenomenological). 

Learning curves. 


Network techniques. 


Learning curves. 
Network techniques. 
Economic analysis. 


Learning curves. 
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STATE OF THE ART 


Uncertain. 


Useful, partly proved. 
Feasible. 


Proven, but limited. 
Feasible. 
Very useful, partly proved. 


Useful within limits. 


Very useful, proved. 


Uncertain. 


Potentially very useful, proved. 


Doubtful. 
Useful within limits. 
Very useful, proved. 


Unsatisfactory. 
Useful, proved. 


Feasible. 

Useful in combination with 
trend extrapolation, etc. 

Feasible? 


Tested, some doubts. 
Unsatisfactory. 
Useful, proved. 


Tested, needs much further 
evidence. 
Feasible. 


Unproved. 
Feasible? 


Very useful, expecially 
discounted cash flow. 


Tested, needs much further 
evidence. 
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Table 6.1 (continued) 


QUESTION APPLICABLE TECHNIQUE STATE OF THE ART 


11. Horizontal impact 
(expecially market 
impact). 


12. Vertical impact. 


13. Lower level goals 
(tasks, missions, 
C1G..).. 


14. High level goals 
(national, social, 
etc). 


Economic analysis. 


Operational models 
(gaming). 

Operational models 
(rigid models). 


Systems analysis. 


Scenario-writing. 
Iteration through synopsis. 
Historical analogy. 
Operational models 
(gaming). 
Operational models 
(rigid models). 
Systems analysis. 
Brainstorming. 


“Delphi” technique. 
Scenario-writing. 


Horizontal decision matrix. 


Vertical decision matrix. 
Relevance tree. 
Systems analysis. 


Brainstorming. 
“Delphi” technique. 
Utopia, science fiction. 


Scenario-writing. 

Operational models 
(gaming). 

Operational models 
(rigid models). 
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Useful in combination with 
other techniques. 


Promising, unproved. 


Useful, proved for esta- 
blished business areas, 
unproved for general 
technological acceptance. 

Useful, proved. 


Promising, being tested. 
Useful, partly tested. 
Uncertain, partly tested. 
Very promising, being tested. 


Promising, unproved. 


Useful, proved. 


Doubtful. 

Useful within limits. 

Feasible. 

Useful, partly proved. 

Useful, being tested. 

Very useful, proved. 

Potentially very useful, partly 
proved. 


Very doubtful. 

Very promising, partly tested. 

Potentially partly useful, 
unproved. 

Useful, proved. 

Potentially useful. 


Potentially useful in 
auxiliary function. 
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2. Since the main interest here is in policy-making and planning in 
education, normative concerns have been merged with exploratory 
forecasting. Exploratory forecasting is concerned with the attempt to 
project futures from a base of (a) fairly certain knowledge of past and 
present, and (b) explicit assumptions about unknowns such as interaction 
effects. Normative forecasting, on the other hand, involves the stipulation of 
a set or alternative sets of societal goals for some time period in the future — 
a period sufficiently time-distant that the commitment of resources is 
minimal — and specifies the sequence of events and courses of action 
necessary to accomplish the goals. These two forms of forecasting, if they 
are concerned with the futures of the same region or nation, feed each 
other. Normative forecasting serves exploratory forecasting by specifying 
areas of inquiry and providing information about goals and objectives; 
exploratory forecasting serves normative forecasting with probablistic 
information about what events are likely to occur if present trends continue 
and if certain breakthroughs take place. Parenthetically, it is worth noting 
that those attitudes which Jantsch (1966) regards as basic to normative 
forecasting — the recognition of responsibility toward society or nation, 
recognition of economic potentials, recognition of an ultimate technological 
potential, awareness of constraints, and hedging against threats — are also 
among the basic attitudes which are preconditions for planning. 

A comprehensive program of social forecasting might be conceived in 
the five stages illustrated in Figure 6.1. It is a preliminary framework for 
interrelating the activities involved in a comprehensive program of social 
forecasting and, of course, needs to be refined through further research and 
attempts to make actual use of such a model. 

Stage 1]. Planning and policy-making in education are fundamentally 
efforts to plot courses into the future of educational systems. They require 
an understanding of forces which have shaped the past, anticipations about 
future developments, and a clear sight on goals and objectives. In this 
context, then, a program of social forecasting to be used in education 
planning must serve three purposes: one descriptive, one exploratory, and 
one normative. Thus, when planning is built upon a system of social 
forecasting, planning and policy making agencies must specify the domains 
of their concerns with respect to the future, that is, what descriptive studies 
and exploratory and normative forecasts they would find useful in the 
development of educational policy and programs. 

Stage 2. Stage 2 involves the analysis and projections of trends 
associated with each of the concerns identified earlier. In terms of our 
model, then, six major streams of activity are required: 

One stream of inquiry is concerned with an analysis of the industrial 
process and technology. Although the two could be treated separately, since 
technology has its impact on society largely through the workings of 
industry (including the service industries such as education) it seems 
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Development of Forecasting Program 
in Interaction with Planning Unit 


STAGE 1 
Analyses of Past Trends and Relationships, 
STAGE 2 Development of Forecasting Models, Projections 


Resource 
Availability 
and 
Development 


Social Life 
and 
Institutions 


Industrial and 
Technological 
Development 


Government 
Policies 


Economic 
Development 


Population 
Processes 


Mapping and Examination of Interactions 


STAGE 3 


Ecological Effects 


Effects of Alternative Policies 


Sensitivity Analysis, Revision 
of Models and Scenarios 


STAGE 4 


STAGE 5 Projected Alternatives of 


Social! Life and Environment 


ab ate : ecreation ; Values, 
Communications Housing R SO Education 
eisure Attitudes 
[ Life in 
Transportation sith 
Institutions 


FIGURE 6.1 
A PRELIMINARY FRAMEWORK FOR A SOCIAL FORECASTING SYSTEM 
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justifiable to collapse the two into a single category for the sake of brevity. 
Questions such as the following might govern these analyses and 
projections: How is the industrial process affected by local, regional, and 
national market conditions? Are any of the industries especially sensitive to 
changes in costs and demand? What are likely to be the new sources of 
power and energy? What technological developments are likely in 
transportation, data processing, communications, food processing, and so 
on? What will be the rate of adopting these technological innovations? 

A second stream of inquiry deals with population processes — 
geographic redistribution of the population, population growth, birth rates, 
death rates, occupational distributions, social stratification, age and sex 
distributions, and so on. Here again, past trends are analyzed and 
projections made on the basis of these identified trends. 

The third stream of activity in Stage 2 is an analysis of trends in federal, 
provincial, and local policies, trends in needs for public services, and a 
projection of public expenditures and revenues by level, based on analyses 
of past and present data, for industrial outputs, resource development, 
adoption of technological innovations, population and government 
expenditures and revenues. 

Another line of analysis involves projection of resource availability and 
development. In addition to speculation about as yet undiscovered 
resources, this implies that thought be given to the prospects of making 
more efficient use of known resources, whether by recycling or by the 
development of improved recovery methods. 

The fifth stream of inquiry has to do with economic development. 
Questions about public revenues and expenditures, the balance between 
primary and secondary industries, the objectives of economic policy, 
industrial incentives, manpower policies, the size of the public sector in 
relation to the private sector, and, ultimately, about the amount of money 
which might be available for educational services would be among the most 
important that could be raised. 

The final line of activity in Stage 2 is an examination of the conditions 
of social life and the nature of contemporary institutions. Although this 
analysis would be one of the most difficult of the six, it is, at the same time, 
one of the most crucial ones. Trends in urbanization, bureaucratization, and 
the structure of institutions such as the family, government, religion, 
science, education, and leisure require particularly careful attention. 

Stage 3. Changes in any of the six domains, no matter how or why they 
come about, often have effects on the others and require adjustments in 
them. And, consequently, once set in motion, the process of change tends 
to be self-perpetuating. For these reasons, Stage 3 involves two main 
activities: 

1. studies of the interaction effects (preferably, by means of a cross 
impact model) between and among developments projected in Stage 2. 
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2. estimates of the ramifications of simulated changes in public policy. 
In effect, this analysis is an initial test of the feasibility of alternative 
policies and of the likely success of planned interventions into the social 
system. 

Stage 3, therefore, adds information and forecasts not directly available 
from the separate forecasts of Stage 2. 

Stage 4. Simply relating forecasts to each other by some procedure does 
not complete the analysis. Two additional steps are required before the final 
images of the future can be produced. The first is an assessment of the 
sensitivity of the forecasts and the interactions among them to initial 
assumptions about the trends and the nature of the connections (enhancing, 
inhibiting, or unrelated) among them. In many cases, the conclusions might 
be unwittingly but significantly biased by assumptions essential to the 
analysis. How often, for example, have linear models proven to be 
inadequate to depict the relationship between two parameters? 

The other is an attempt to meet the criterion of internal consistency. It 
seems likely that a single pass at interrelating discrete forecasts would not 
yield consistent results and that, instead, a variety of contradictory or even 
mutually exclusive forecasts could be obtained. Stage 4, then, also 
represents an iterative process for examining and revising forecasts so that 
consistent images of the future of each of the domains taken singly or in 
combination might be obtained. 

Stage 5. Once the final estimates of the future have been generated 
through these “hard” procedures, their social and environmental 
implications need to be examined critically, elaborated imaginatively, and 
then judged carefully. By means of Delphi procedures and other intuitive 
techniques, there can be developed silhouettes of the future of urban life, 
recreation and leisure, human relationships to and in a variety of social, 
economic, and political institutions, values and attitudes held by the 
population, the nature of various social institutions, and consequences for 
the biological and physical environment. 


Linking Futures and Education Planning: Some Summary Comments 


In many ways, the effective linkage of systematic futurology and 
education planning is now little more than a pious hope. Recognition of the 
importance of futures study is growing, if for no other reason than that it 
can help to anticipate and possibly to avoid crises. But the gap between the 
hope and the deed is very wide indeed. And the strength of the argument in 
favor of social forecasting is not in itself sufficient to ensure that the gap 
will be bridged. 

How, then, might an anticipatory, look-out capacity be built into the 
planning process? In the first place, it seems that the creation of special 
agencies for future study cannot be avoided. At the present time, virtually 
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every government department is responsible for the study of the future. But 


this arrangement simply hasn’t worked — concern for the future has been 
lost in the pressures of the present. Such a special unit, while autonomous, 
must develop close relations with other departments. Ideally, it would 
achieve interdepartmental status, perhaps after the model of successful 
national statistical agencies. 


Obviously, much depends on personnel and their training, experience, 
and commitment to the study of the future. What is not so obvious, 
however, is that what might be said about the staffing of government applies 
to both employees of government and elected officials. 

The last suggestion to be considered here (we will return to these 
problems in the next chapter) has to do with changes in the ways in which 
public decisions are made. Patterns of government decision making must be 
“calculated to reinforce the consideration of futures (Dror, 1968, p. 45)”. 
There are no easy ways to do this, but perhaps the best place to start is to 
concentrate on injecting attention to long range problems into the 
budgetary process. 

In summary, a fully effective solution to the problem of linking futures 
and planning in education will require a variety of simultaneous, mutually 
supporting changes in the organization of government, recruitment to 
elective and non-elective public office, and patterns of public decision 
making. Each of these, by itself, is a tall order. Taken together they 
represent an overwhelming task to the optimist and an impossible one to the 
pessimist. 


110 


CHAPTER SEVEN 


FITTING THE PIECES TOGETHER: THE POSSIBILITIES FOR 
“SECOND GENERATION” PLANNING IN EDUCATION 


Practical men, who believe themselves to be quite exempt from any 
intellectual influences, are usually the slaves of some defunct 
economist. 

John Maynard Keynes 


Few of the new, powerful approaches to planning education have found 
their way into practice where, for the most part, antiquated criteria 
continue to serve as guides for action. To be sure, there have been bits and 
pieces of the “‘new planning” added to the old processes, but, by and large, 
they have been tacked on hastily, as patchwork solutions to immediate 
problems. 

Yet to identify problems and promising solutions, as has been done 
thus far, is only a first step, albeit a very necessary one, in bridging the 
inevitable gap between planning theory and practice. The next step involves 
putting the pieces together using models, diagnoses of current planning 
practices, and recent developments in planning-related sciences, and 
outlining the conditions under which the new structures and processes 
might work. This is the final task set for this book. 

In this chapter some suggestions, necessarily brief, are put forward for 
improving planning practices in education. The discussion focuses on 
(1) the scientific analysis of public policy, (2) incorporating techniques for 
social accounting, social forecasting, and rational calculation into the 
planning process, and (3) roles of actors in the planning process, especially 
those of boundary personnel. The suggestions are intended to be specific 
enough to serve as useful guides for changing planning and policy making in 
education and yet general enough to be applied, if they are filled out with 
detailed data, in a variety of situations. 


Social Research and Educational Policy 


One need only have a casual acquaintance with educational systems to 
know that more and more programs are, in one sense or another, planned. It 
is often harder, however, to detect anything other than a political sort of 
logic or a routinized “projection-reaction” framework underlying plans and 
the ways in which they are developed. This is not intended to derogate the 
conventional wisdom of planning by comparing it to the potential power of 
contemporary social science, or to downgrade policy decisions made with a 
sharp eye to popular reactions. Rather, it is meant to suggest that the 
imperatives of social science are different from those of political decision 
making and that, if arrangements can be made to link them more effectively 
in practice, each can strengthen the other. The principal contributions of 
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social research to public policy can be summarized in four words — 
descriptions, analysis, evaluation, and prediction. While the following 
discussion raises issues relevant to each of the four, it is directed especially 
toward the evaluative character of social research, that is, toward its use in 
the appraisal of existing government policies or programs and as a guide for 
policy development or program review. 

Such pleas for a policy science, for developing a reliable empirical basis 
for generalizations and recommendations about policy making, have been 
made many times. Yet in spite of the frequency of these appeals, the 
connections between social science and the practice of social policy-making 
have remained very weak. Most scholars who have examined this 
relationship have identified a number of barriers in the way of effective 
utilization of social science in actual policy making. Some reflect rather 
broadly based cultural concerns — such as fears of “‘social engineering” and 
the loss of privacy or laissez faire concepts of the function of government. 
Other concerns are raised by policy makers who rely on some sixth sense for 
gauging correct courses of action, who take the position that the real 
sources of social knowledge are experience and common sense, not scientific 
inquiry, and who make use of social science only when it will bring political 
advantage. Still other obstacles can be traced to the social sciences 
themselves — the dearth of timely, policy-relevant research, the assumptions 
that scientific rationality is superior to political rationality and that policy 
makers need prescriptive advice from social scientists, and the absence of 
effective means for communicating the results of research to policy makers. 

There are, obviously, no easy solutions to these problems. But, 
although the job of linking the science and practice of social policy has 
hardly been begun, we can mark the contours of improvement by focusing 
on (1) the development of a policy science, and (2) ways and means of 
removing the above-mentioned barriers. 


Eliminating the Obstacles 


In the past, the speculations of social philosophers and the findings of 
social scientists have found their way into the functioning of government 
only very slowly. Now, the increasing power of the social sciences and 
growing public impatience with simple-minded approaches to social 
problems have lent much urgency to appeals for a more productive union of 
the two. 

How, then, might these obstacles be overcome and how might the 
contribution of social science to policy making be augmented? There are 
several conditions: 

1. Policy research should reflect political needs, political realities, and 
the general goals of policy makers. As such, policy research should be 
timely, action-oriented, directed at improving public policy and encouraging 
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its use in the policy making process. It should be concerned with critically 
examining expressed needs for public programs, with identifying social 
concerns in need of attention, and with providing instrumental knowledge 
about how goals might be achieved, no matter what the substance of the 
goals might be. 

2. the value premises underlying policy research should be made 
explicit, communicable, and, to the extent possible, arrived at jointly by 
scholars and practitioners. Questions like “What problems should be 
examined?” “What are suitable indicators?” “How are the results to be 
interpreted?” and so on can be answered only in part by looking to the 
routines of scientific inquiry. A full answer to any of them requires an 
appreciation of the normative bases of both social research and politics. A 
productive answer depends on the recognition and, where possible, a 
reconciliation of the differences between them. So, for example, imagine a 
somewhat stereotyped social scientist — claiming that he is value-free and 
objective, striving for certainty in his research but unwilling to give 
unequivocal advice, and using the jargon of his discipline — in conversation 
with an equally stereotyped politician — lobbying for a particular set of 
values, looking for specific advice on policy, and examining problems in the 
context of his common sense. It is hard to think of two people who might 
have a more difficult time communicating effectively with each other, 
unless, perhaps, the proverbial son- and mother-in-law come to mind. 

3. policy research should focus on pragmatic as well as “ideal” 
solutions to social problems. Ideal solutions to human problems can usually 
be conceived, but they can be implemented only very infrequently, if ever — 
generally, they require excessive commitments of human and financial 
resources and they are too distant in time. Solutions based on expediency 
often suffer from defects that are just the opposite — insufficient 
commitments of resources and programs that are tied too closely to present 
conditions. As always, the middle ground is the best ground, and the hardest 
to secure. In Dror’s phrase, the solutions should be “realistically idealistic’, 
neither distant utopias nor situations that will come about as a matter of 
course. They should be alternatives that can be approached if the policy 
makers are willing to make a serious effort to do so. 


The Development of a Policy Science 


To date, the study of public policy making has taken two forms — one 
the subjective impressions of social philosophers and experienced 
politicians, and the other the more empirical investigations of scientists 
from particular disciplines. The shortcomings of each of them, the 
discomforting subjectivity of the former and the fragmented view of society 
that results from the latter, suggest the need for a policy science with the 
following characteristics: 
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1. orientation. The central concerns of policy science should be with 
the actual problems of policy making and with improving the policy making 
process. At the present time, certain branches of economics come closest to 
achieving this, and, it is worth noting, do so without threat to the place of 
pure research and theory within the discipline. 

2. organization. The need to obtain a holistic view of the policy 
making process in the public sector rules out the possibility of tying policy 
science to any one of the existing social sciences, for each of them brings a 
particular disciplinary perspective (and, therefore, a partial perspective) to 
bear on the policy making process. The development of a policy science 
depends on making the boundaries among the disciplines permeable, on 
overcoming the tendency to hide knowledge behind the jargon and routines 
of a particular discipline, and on creating a setting in which this exchange 
can take place and be reinforced. 

3. Setting. The inadequacies of policy research conducted either 
within the government or within traditional university structures strongly 
suggest that if policy science is to develop satisfactorily it should be housed 
in an independent institute or in a special multi-faculty unit within the 
university. 


Adjusting the Roles of Actors in the Planning Process 


Studies of education planning and policy making, and attempts to 
improve them, usually turn around what Ewing considers “bloodless” 
questions. How much space is available? What enrolment is expected? What 
is the supply of qualified teachers? Where are facilities to be located? At 
what level are decisions to be made? And so on. 

Such questions are, without doubt, basic and important. But they do 
not take into account the fact that the single most important variable in the 
improvement of planning and policy making is human. A better list of 
questions would include the following: How are the planning and policy 
making processes organized? What kind of people man the processes? What 
training and experience do they have? How were they recruited? What are 
their roles? What responsibilities have been assigned to them? 

Clearly, much can be said about the importance of improving personnel 
through better training, recruitment, and selection of procedures. Because 
the point is such an obvious one, the possibilities will not be pursued any 
further here, except to point out that what can be said about personnel in 
the civil service should, at least ideally, apply equally well to elected 
offficials. Instead, this section will concentrate on (1) possible adjustment 
to the roles of actors in the planning and policy making process and (2) the 
special functions of boundary personnel. 
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Boundary Personnel 


Relations between organizations and units involved in the planning 
process, whether competitive or cooperative, are in large part dependent on 
the ways in which the persons responsible for maintaining these contacts 
perform their roles. These persons, who are really linking pins in the 
structure of communications between units, are faced by conflicting 
pressures: to insulate the unit from demands it cannot or does not want to 
meet and, at the same time, to keep it open to appropriate demands and 
supports. And it is through them that a number of critical organizational 
processes often take place, including (1) the definition and redefinition of 
the organization’s goals and of the limits on its autonomy; (2) the 
mobilization of organizational resources; and (3) obtaining feedback. In 
short, the personnel in such intermediate positions have a pervasive 
influence on the movement of the planning cycle from task to task and 
agency to agency. Most of these boundary functions are carried out as a 
normal part of an organization’s operations. Some boundary contacts are 
made informally as individuals meet with others outside of their immediate 
area. Certain other contacts are made formally — at committee meetings 
involving representatives of various agencies, for instance. 

In such a context, then, most individuals in an organization play a 
boundary role. Obviously, however, certain position are more crucial to the 
organization than others. Two such positions stand out: (1) senior posts, 
because incumbents have responsibilities for the management of the 
organization and for receiving or channelling inputs from outside agencies; 
and (2) positions created for handling external relations such as 
information officers, field officers, and so on. 


Roles in the Policy Making Process 


Rationalizing the planning and policy making processes in education 
depends on much more than simply developing quantitative tools for the 
analysis of educational problems (these tools will, in any event, be used by 
professional analysts with a disciplinary logic). More important, it requires 
the injection of a systematic approach to the analysis of complex problems 
into all phases of the policy making-planning cycle and assurance that all 
actors in the cycle, politicians as well as civil servants and policy scientists, 
have the capacity and support services needed to do the job properly. 

Even if more able personnel were attracted to the public service, such a 
happy state of affairs would not come about automatically. A fully effective 
solution to the problem of improving policy making and planning also 
requires that the processes be organized in such a way that the gains made 
by attracting better personnel and incorporating improved methods of 
problem analysis can be reinforced, not undercut, by inadequate channels of 
communication and inappropriate role assignments. 
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The organization of the planning process should be based on the tasks 
to be performed and the contributions that can be made by the various 
participants in the process. As usual, this is easier said than done. When 
planning is viewed as a cyclical process, it is difficult to identify discrete 
tasks and to assign them to specific actors. Potentially, at least, the number 
of actors in the process can be very large, almost unwieldy. 

Yet, looking at what seem to be the more important features of 
planning as we have described it, a number of basic considerations stand 
out: 

1. the length of time available between the points at which a need for 
action is identified and a decision must be made. 

2. the proper place in the system for making planning decisions. 
Should the process be started “from below” or “from above’’? 

3. the number of agencies outside government to be contacted in the 
planning process. 

4. the frequency of contacts with outside agencies. 

5. the time order of these contacts. 

These considerations, although very general, provide guidelines for 
organizing the planning process and making appropriate role assignments to 
various actors in the process. Clearly, there can be an endless number of 
variations in the pattern depending on the situation. Figure 7.1 illustrates 
the possibilities. 

Briefly, this scheme is essentially a way of looking at a process by 
which complex public decisions might be made. It outlines the major stages 
of the policy-making cycle and provides an organizational network for 
carrying the process forward. While policy making is a continuing process, 
and channels of communication and the roles of participants unfold in the 
process, such schemes are essential starting points if the organization of 
public policy making is to be improved. 

Contrast Figure 7.1 with Figure 7.2, which provides a traditional 
description of the characteristics of coordinating (or planning, at least in the 
first generation sense of the word) agencies. Figure 7.2 compares university 
coordinating agencies in the provinces of Canada. It is legalistic and says 
virtually nothing about the operation of the agencies. Although the table 
identifies the composition of the various agencies, it does not describe the 
roles of actors in the coordinating process. The table is taken from the 
Hurtubise-Rowat Report on Relations Between Universities and 
Government (1970). ! 


lin some respects this comparison is an unfair case, because it takes the 
Hurtubise-Rowat materials out of context. But the Hurtubise-R owat table is typical of 
most descriptions of the organization of planning. It has been used for that reason 
alone. 


116 


THE POSSIBILITIES FOR “SECOND GENERATION PLANNING” 


SSA0O0Ud ONINVW ADITOd AHL AO SLNAWATSA ‘TL AaNOIA 


‘sSurreay uodo ul smata juasaid 0} Aytunjioddo pur ,,d1nyjno o1AI9,, UO BuIpusdap ‘ayqeeA ATYSIY UOTINGI}UOD =A 


uoI}NquyUuoS IOUT y. uonNqiyU0S WINIpsw , » UOIINGINUOS IOfPU yyy 


A A A A A A as1e[4e-O11QNd 
=r * ok ek oat ren sdnois }so19] Ul 
poazruesiO 
= *k ok kK ok x sjiodxo apisinoO 
= 2 a ae we so1nuase Yoiessol 
ie iss [Be] USWIUISAOL) 
SJUPRAIOS 

BE OK x 
: i tae [IAIO IOTUAS 
=m * ** * oe ace QIN} PISIBI] *Z 
de *k OK * eK kK youtqes ‘| 


:gjdood ay} 
JO soatyejUuosoiday 


urajqoid oy} 
Jo uo eoulfep 

S}SBIDIOJ JO SOAI}BUIO}[C SOATJEUIO}e JO sonwotd pue poou jo 

UOTISIN9q uoljoNnI}suo,D jo sjsoy UOT BOTT} USP] [eos 19S UOT VOTJIZUIP] 


SSad0Ig 
sulyey Aoyod 
oY} UI SIOJOY 


SSA0OUd ODNINVW AOITOd AHL AO SLNAWATA GALOATAS 


hy 


ile ee ee ee ee SS SS. SS Eee SS ee 


pq jo wa SIOUIOAOS) (sosndures Z) (8961 Pastaey) 
pieog ajyeuas Aq oat ‘rainseoiy Ajndoqd QT SUIUIOAON jo pivog I LO6T $9 9V UPBMIYOIE ASS 
‘pa jo Wd sew UOISSTULUIOD 
uRWIITeYO ‘uoT}eonpy OAT]NIIX | sJUuPI 
JUDUIUTOAOL) oUuON Jo roysiury Ayndod 6 a AIOSIADY SOIISIOATUL) S 196 LJOROM BQO UPI 
STBIFV 
“Vf JO JoysTUry “AIAG SI SMV AVISIOALU () 
jo uolepusuIWOodal AVISIOATUL) JO AIOSIAPY p96 Jo 
UO JUSUIUIOAOL) ouON roystul, Ajndaq a AIOSIAPY UO 99}} IWIUIO) atl [louno)-ul-19p1O OUk}UOQ 
‘uoneonpy “IOQR] W Ssoulsng YIM 
JO Id}SIUT UONeI[NSUOD IJ9}Je INO 
jo uonepusWWodal “UONRI[NSUOD I9}Je SOITISIOATU A) 
UO JUSUIUTOAOL) —- SOT} ISIOATUN WOT] JUIN “payroods om |, ball ALOSIAPV jo [lounog call 996] JO 10V saqong 
_ UOT eoNps 
“IOge] WZ ssoursng Are puooas 
WIO1} YORd [ 1SP9T}V -ysod Aqisioatun UOTSSTUIULO > 
“QOITWIWOD APISIOAIUN -UOU YIM poured dAT]NIOX | uoneonp | (Q96]| Pastady) 
JUDWIUIIAOD ve Aq pasodoid ¢ -uU0d,, :] 18891 1V 3 AIOSIAPY 1oysipy if L961 JOY — AOTMs uN MON 
a0ueUul.{ Jo $99} } TUTWO °) (S96I Pastaay) 
JUDUWIUIIAOD) auoN Joystury, Ajndoq ALOSIADW sjurID ‘ATU eI €96]| JO19V BILOIS PAON 
. auatadxo uoneonpy 
s1Wapeor * ~~ JARY SAI NIOX | "99S-180d purys| 
JUQUWIUI9IAOSL) []TeYs 9Uuo seal 1V,, poyroods su0N aw AOISIAPY UO UOTSSTULUIO -) C R96] JO IV preMp yy dull 
$]UD59Y (996| PASTAdy) 
JUQUWIUISAOS) UOT} RIOAUO) Aq OMT, patioods su0N BUIUIOAOL) jo preog I 661 JO19DV pur] pUuNOJMON 
Ag pojutoddy pouwoads sTRIOUIO 1aMog Apog (sosa[OD : ayeq pur JOUIAOI 
uPLUIIRYD SOATPR] UdSaIdoy jo adAy Jo OWRN pue ‘SALUP) JUDLUNIJSUT SUIVRAL) 


jo Jaquinn) 


118 


THE POSSIBILITIES FOR “SECOND GENERATION PLANNING” 


uOoT}ISOdUIO ,) adoas 


SHIONADV ONILVNIGUOOD 
ALISYAAINN NVIGVNW) AO SISATVNV HALLVaYVdWNOO 


Cf aadnvis 


THE POSSIBILITIES FOR “SECOND GENERATION PLANNING” 


— A[UO SONISAOATUL] JO JOQUINU oY} SMOYS 
“TUN}NODIY.) PUB SOTSIALY STOLL “[ROJUO cSosndured do1Yy] SPY YOEYA “DaQaN) JO ATISIOATUL] MOU OY] SOpNpoUu] 


ayeuas yoro preog 

pieog Aq OM} :XIS poyioads suo N 6 AIOSIAPY JIWApBIY gee €96I JO 10V 

; (€961 Jo 

SIOUIOAOL) QoUeULY JOY Jopun) 
uoneonpy JO pieog yora uo pleog uotjeonpy eIquin[O.) 
JO Jo}STUTy AQ duo 9014], juasoid 3 oa], y: AXOSIAPD Y AIOSIAP YW € JO IoSIUIP ysnug 

PAJO Wad SAT}NOOX | UOTSSTWIUWIO7) 
JUSWIUI3AO‘) ouON ‘Joinseary, Ajndaqg 6 3% AIOSIAPY SOIPISIOATU() € 9961 JO 19V eWOQG|V 
Ag pajuioddy porroads s[eIoyjo Apog IaMOod Apog (sasa][op 31eq pure DOUTAOI 
UBULIIEYD SOAT} EY UDSoIda Y JO-9ZIS jo adAy jo oweN pue ‘SATU: }UDUINISUy 3UN RAID 
jo Joquinn) 
uoljIsodwo7 adoos 


Hy 


THE POSSIBILITIES FOR “SECOND GENERATION PLANNING” 


A Last Model: Building Social Forecasting, Social Accounting, and 
Quantitative Analysis into Educational Policy Making 


Education planning, as we have described it, has three essential 
characteristics. It is anticipatory — decisions are made for the future. It is a 
cyclical and continuing process — it does not come to a halt with the 
production of a plan. And it takes place in a dynamic context which 
requires the system to make adjustment to changes in its environment. The 
tools which now promise to make this approach to planning something 
moye than a pious hope are of a fairly recent origin, have been developed 
independently within the boundaries of particular disciplines, and, 
consequently, have not been firmly connected to practice. In this, the final 
section of the book, one possible way to conceive these linkages and to put 
them into effect is illustrated. 

There is no quick or easy way in which this might be done in practice. 
Thankfully, the task is easier on paper. Figure 7.3 incorporates social 
accounting, social forecasting, and procedures for quantitative program 
analysis, showing some of the basic connections between them and their 
relationship to policy decisions. 

The main premises on which the model is based and its principal 
features include four conditions: 

1. Critical events in the policy making and planning process (deciding 
what public policy and programs will in fact be adopted and providing the 
norm-laden information which guides the processes) are duly allocated to 
political agencies. Yet, it must be understood that if policy makers and 
planners are to benefit from these techniques, they must in turn support 
and reinforce their use. 

2. The approach taken to social forecasting must coincide with the 
requirements of planning and policy making, for this is the only way in 
which speculations about the future can be used for actually moulding the 
future. 

3. Planners and policy makers must systematically evaluate standing 
policies and ongoing programs, and Jearn by experience from the actual 
operation of public programs. Evaluative activity, of course, is central to 
each element of the model, yet it is particularly important in those dealing 
directly with social accounting, where social progress and the quality of 
social life are assessed. Evaluation in this context serves a dual purpose — as 
feedback and as a guide for future action. 

4. While the model is oriented more to quantitative concerns than to 
quantitative planning problems, the potential contribution of quantitative 
techniques for the review of ongoing programs and the appraisal of possible 
new programs should not be overlooked. 
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Toward Implementation 


A process of planning and policy making strengthened by social 
accounting systems, systematic studies of the future, and quantitative tools 
for program analysis might be implemented by the following steps: 

1. In order to make a start, the scope of adjustments to the 
contemporary policy-making process and of new programs must be 
determined. Is the process to be totally revamped? Will all known support 
techniques be used and many new ones devised as well? Which public 
concerns will direct policy making? 

On the face of it, it might seem that the best answer would be to opt 
for a very comprehensive scheme, with the aim of doing everything that 
might appear significant. Even assuming that it could be done (and this 
assumption does not hold) the costs of this option would be tremendous 
and would far outweigh any benefits which might accrue to society through 
improved policy making. 

A second alternative would be to develop a comprehensive taxonomy 
of possible policy support techniques from which users could select those 
which best fit their needs. Although this might be achieved with sufficient 
commitment of resources, it is probably too ambitious at this time. 

The most feasible approach seems to be to begin with the best available 
techniques, to apply them to certain ongoing public programs, to evaluate 
them, to measure the progress of society under them, to forecast their likely 
effects on the shape of society, and so on. Purists are likely to disagree with 
such a strategy and express concern about its implicit gradualism. Yet the 
process of reform must begin with policy making as it exists, not as 
someone wishes it to be. And improved policy making cannot be achieved 
suddenly — it requires a determined effort over a long period of time. 

2. The essential common concern of these tools is their focus on 
remedying the defects of contemporary planning and policy making. As a 
result there has been extensive overlapping among them. Thus, the next step 
is to generate a list of all relevant techniques, incorporating information 
about their important assumptions, central theoretical constructs, and 
principal advantages and limitations, and then to develop a scheme for 
organizing them into categories that are, to the extent possible, mutually 
exclusive. 

3. A procedure must be developed to match systematically the needs 
of policy makers, the purposes of analysis, and the various policy analysis 
tools. Without such a specification of which tool would be appropriate to 
what kind of problem, the application of these tools will remain as they are 
at present — random and unconnected to the real needs of policy makers. 

4. Pilot studies must be undertaken in field settings of the usefulness of 
the various tools in dealing with specific problems of policy making. 

5. On the basis of actual experience (hopefully generalizable), the 
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interrelationships among the techniques and between the tools and the 
structure and processes of policy making must be worked out. 

6. The essential elements of the tools and the central features of the 
policy-making process must be isolated and their mutually supporting 
characteristics identified. This should enable users to draw conclusions 
about the likely usefulness of the tools in their situation, to make use of the 
most promising of these, and to organize and place in sequence their 
contributions to policy making. 

7. If these tools are to be used, the generalizations obtained in the 
previous stage have to be translated into operational or prescriptive terms — 
a series of “how-to-do-them”’ guides. It is highly unlikely that they will be 
adopted widely at the outset, even if such guides are made available, so the 
questions of a dissemination strategy and creating a state of readiness among 
potential users are likely to become crucial. Although higher authorities can 
bring pressure to bear on lower jurisdictions for their adoption, much 
depends on the state of the adopting system at the time of implementation, 
the commitment of users, the availability of competent personnel, and the 
attitude of influential politicians toward the tools. 

8. The process must be continued, recycling through the above steps, 
so that public policy may in time become better (the notion of better is an 
elusive concept, for it, too, changes with time and the promise of new 
developments) and approximate ever more closely some idealized standard. 

In brief, then, what has been described is a way of ordering the 
evolution of policy making systems so that they might handle complex 
problems with growing sophistication. Such a systematic approach has a 
number of advantages that make it feasible: 

1. It is concerned with both the immediate, real problems of policy 
makers and planners and their likely future problems. 

2. It meets the needs of policy maker, policy scientists, and social 
scientists, rather than downgrading the importance of any two of them for 
the sake of the other. 

3. It represents a careful, determined, and purposeful approach to the 
redesign of policy making and an orderly way to integrate newly developed 
tools with established policy making procedures. 


Conclusion 


This book has described an attack on the problem of education 
planning which sets out to combine some of the most promising tools of 
modern social science with many of the hard political realities of planning 
and policy making. But, what if they cannot be combined in practice? What 
if natural obstacles to rationalizing public policy making prove to be 
insurmountable? What if social science fails to follow through its early 
promise? 

Some failures, at least, are inevitable — but one can sometimes learn 
more from them than from successes. The process of developing any 
science, and planning science is no exception to the rule, is a continuing 
cycle of theory building and hypothesis formulation, refutation, and 
amendment. It is to be hoped that better theories and more accurate tools 
will gradually become available. Much depends on better data, creative 
scholarship and stimulating speculation. But it should not be forgotten that, 
in the words of Jan Tinbergen, “the role to be played by scientific 
knowledge and insight in the field of (public) policy will for a long time to 
come be only a modest one.’ The important features of social life are too 
numerous and diverse to make policy decisions without a strong intuitive 
feeling for human beings, their capacities, and their problems. 

Planning is an art-science of the possible. Its success depends not on 
so-called “bloodless” calculations and criteria, but on people and guiding 
their behavior in socially acceptable ways. 


124 


REFERENCES 


CHAPTER ONE 


Coombs, P.H. The world educational crisis. New York: Oxford University 
Press, 1968. 


Waddington, C.H. Assessing the Priorities. Science Journal, 5A, 4, 1969. 


CHAPTER TWO 


Dahl, R.A., & Lindblom, C. Politics, economics and welfare. New York: 
Harper, 1953. 


Easton, D. A systems analysis of political life. New Y ork: Wiley, 1965. 


Heufner, R.P. Strategies and procedures in state and local planning. In E. 
Morphet and C. Ryan (eds.). Planning and effecting needed changes 
in education. New York: Citation Press, 1967. 


Kahn, A.J. Theory and practice of social planning. New Y ork: Russell Sage 
Foundation, 1969. 


Sibley, W.M. Universities and the new planning. Paper presented at the 
Conference on Canadian University Planning, Thunder Bay, 
Ontario, May, 1970. 


UNESCO. Educational planning: a survey of problems and prospects. Paris: 
Author, 1968. 


Waddington, C.H. Assessing the priorities. Science Journal, 1969, S. 
CHAPTER THREE 


Abel-Smith, B. Freedom in the welfare state. Fabian Tract 353. London: 
David Neil, 1964. 


Arrow, K. J. Public and private values. In S. Hook (Ed.), Human values and 
economic policy. New York: New York University Press, 1967. 


Arrow, K. J. Social choices and industrial values. New Y ork: Wiley, 1951. 


Bailey, S. K. and others. Schoolmen and _ politics. Syracuse: Syracuse 
University Press, 1962. 


Baldwin, G.B. Planning and development in Iran. Baltimore: Johns Hopkins 
Press, 1967. 


Banfield, E. C. Three concepts for planners. In E. C. Banfield (Ed.), Urban 
government. New York: Free Press, 1969. 


P23 


Bauer, R. A. Detection and anticipation of impact: the nature of the task. 
In R. A. Bauer (Ed.), Social indicators. Cambridge: M.I.T. Press, 
1966. 


Baum, B.H. Decentralization of authority in a bureaucracy. Englewood 
Cliffs: Prentice-Hall, 1961. 


Bell, W. and Force, M. T. Social structure and participation in different 
types of formal associations. Social Forces, 1956, 34. 


Berkowitz, N. H. and Bennis, W. G. Interaction patterns in formal 
service-oriented organizations. Administrative Science Quarterly, 
196156. 


Bestuzhev-Lada, I. Forecasting: an approach to the problems of the future. 
International Social Science Journal, 1969, 21. 


Blau, P. M. Social integration, social rank and the process of interaction. 
Human Organization, 1959-60, 18. 


Blau, P. M. & Scott, W.R. Formal organizations. San Francisco: Chandler, 
1962. 


Boguslow, R. The new utopians. Englewood Cliffs: Prentice-Hall, 1965. 


Bolan, R. S. Emerging views of planning. Journal of the American Institute 
of Planners, 1967, 32. 


Bor, M. Aims and methods of Soviet planning. New York: International, 
E967. 


Brand, W. Planning for balanced social and economic development in the 
Netherlands. In United Nations Department of Economic and 
Social Affairs, Planning for Balanced Social and Economic 
Development: Six Country Case Studies. New York: UNESCO, 
1964. 


Bredimeier, H. C. and Stephenson, R. M. The analysis of social systems. 
New York: Holt, Rinehart and Winston, 1962. 


Bruno, F. Trends in social work. New York: Columbia University Press, 
1948. 


Bunzel, J. Planning for aging. Journal of the American Geriatric Society, 
196) 9: 


Burke, F. G. The cultural context. In B. Gross, (Ed.), Action under 
planning. New York: McGraw-Hill, 1967. 


Burns, E. M. Social security and public policy. New York: McGraw-Hill, 
L956, 


Burns, T. and Stalker, G. M. The management of innovation. London: 
Social Science Paperbacks, in association with Tavistock 
Publications, 1961. 


Cahn, J. C. and Edgar, S. The war on poverty: a civilian perspective. The 
Yale Law Journal, 1965, 73. 


Campbell, R. F., Cunningham, L. L. and McPhee, R. F. The organization 
and control of American schools. Columbus, Ohio: Charles E. 
Merrill, 1965. 


Cartwright, D. & Zander, A. (Eds.) Group dynamics, research and theory. 
(2nd ed.) Evanston, Ill.: Row, Peterson, 1960. 


Chapin, F. S. & Tsouderos, J. E. The formalization process in voluntary 
organizations. Social Forces, 1956, 34. 


Cloward, R. A. Private social welfare’s adjustment agencies. In M. N. Zald 
(Ed.), Social welfare institutions. New York: Wiley, 1965. 


Coleman, J. S. Community Conflict. Glencoe: Free Press, 1957. 


Commager, H. S. The American mind. New Haven: Yale University Press, 
1 30, 


Committee for Economic Development. Budgeting for national objectives. 
New York: Author, 1966. 


Cyert, R. M. and March, J. G. A behavioral theory of the firm. Englewood 
Cliffs: Prentice-Hall, 1963. 


Dahl, R. A. Modern political analysis. Englewood Cliffs: Prentice Hall, 1963. 


Dahl, R. A. and Lindblom, C. E. Politics, economics and welfare. New 
York: Harper,1963. 


Davidoff, P. and Reiner, T. A. A choice theory of planning. Journal of the 
American Institute of Planners, 1962, 28. 


Davis, J. S. Implications of prospective United States population growth in 
the 1960’s. Milbank Memorial Fund Quarterly, 1961, 39. 


Deutsch, M. A theory of cooperation and competition. Human Relations, 
1949, 2. 


Dill, W. R. The environment as an influence on managerial autonomy. 
Administrative Science Quarterly , 1958, 2. 


Dominion Bureau of Statistics. Education planning and the expanding 
economy. Ottawa: Queen’s Printer, 1964. 


Dorfman, R. (Ed.) Measuring benefits of government investment. 
Washington, D. C.: Brookings Institute, 1965. 


Dorsey, J. T., Jr. A communication model for administraton. Administrative 
Science Quarterly, 1957, 2. 


L2/ 


Duncan, O. D. and Schnore, L. F. Cultural, behavioral and ecological 
perspectives in the study of social organization. American Journal 
of Sociology, 1959, 65. 


Durkheim, E. The division of labor in society. Glencoe: Free Press, 1949. 


Dykman, J. W. Social planning, social planners and planned societies. 
Journal of the American Institute of Planners, 1966, 32. 


Eide, K. The planning process. In S. Elam and G. Swanson (Eds.), 
Educational planning in the United States. \tasca, Ill.: Peacock, 
1969: 


Ellul, J. The technological society. New York: A. A. Knopf, 1964. 


Etzioni, A. Authority structure and organizational effectiveness. 
Administrative Science Quarterly , 1959, 4, 43-67. 


Evan, M. The organization-set: toward a theory of interorganizational 
relations. In J. D. Thompson (Ed.), Approaches to organizational 
design. Pittsburgh: University of Pittsburgh Press, 1966. 


Ewing, D. W. The practice of planning. New York: Harper, 1968. 
Ewing, D. W. The managerial mind. New York: Free Press, 1964. 
Ewing, D. W. The human side of planning. London: Macmillan, 1969. 


Fainsod, M. How Russia is ruled. Cambridge: Harvard University Press, 
eee 


Farris, R. E. L. Social disorganization. New York: Ronald Press, 1948. 


Frank, A. G. Goal ambiguity and conflicting standards: an approach to the 
study of organization. Human Organization, 1959, 17. 


Frank, L.K. The need of a new political theory. In Toward the year 2000: 
work in progress. A special issue of Daedalus, 1967, 95. 


Frankel, C. The democratic prospect. New York: Harper, 1962. 


French, J. R. P. Jr. and Snyder, R. Leadership and interpersonal power. In 
D. Cartwright (Ed.), Studies in social power. Ann Arbor: Institute 
for Social Research, University of Michigan, 1959. 


Friedman, J. A. A conceptual model for the analysis of planning behavior. 
Administrative Science Quarterly, 1967, 12. 


Friedman, M. Capitalism and freedom. Chicago: University of Chicago Press, 
E9G2s 


Fuchs, V. R. The growing importance of the service industries. New Y ork: 
National Bureau of Economic Research, 1965. 


Gabriel, R. H. The course of American democratic thought. New York: 
Ronald Press, 1956. 


Galbraith, J. K. The affluent society. Boston: Houghton Mifflin, 1958. 


Georgopoulos, B. S. and Tannenbaum, A.S. A study of organizational 
effectiveness. American Sociological Review, 1957, 22. 


Ginsberg, E. and others. The pluralistic society. New York: McGraw-Hill, 
1965. 


Glazer, N. Housing problems and housing policies. The Public Interest, 
LOS%y ih 


Goode, W. J. Community within a community: the professions. American 
Sociological Review, 1957, 22. 


Goodenough, W. H. Cooperation in change. New York: Russell Sage 
Foundation, 1963. 


Gordon, C. W. & Babchuk, N. A typology of voluntary associations. 
American Sociological Review, 1959, 23. 


Gorham, W. Allocating federal resources among competing social needs. 
Health, Education and Welfare Indicators, August 1966. 

Greer, S. Situational pressures and the functional role of the labor leader. 
Social Forces, 1953, 32. 

Gross, B. M. The “drifting cloud” of guided development. In J. Friedman 
(Ed.), Venezuela: from doctrine to dialogue. Syracuse: Syracuse 
University Press, 1965. 

Gross, B. M. When is a plan not a plan? Challenge, December, 1961. 


Gross, B. M. National planning: some fundamental questions. The American 
Behavioral Scientist, December, 1964. 

Gross, B. M. From economic bookkeeping to social accounting. In 
Twentieth Anniversary of the Employment Act of 1946. Joint 
Economic Committeee, Twentieth Anniversary Symposium of the 
Employment Act of 1946: An economic Symposium. Washington, 
D. C.: Government Printing Office, 1966. 

Guth, W. D. and Tagiuri, R. Personal values and corporate strategies. 
Harvard Business Review, September-October, 1965. 


Hagen, E. E. Planning economic development. Homewood, Ill.: Richard D. 
Irwin, 1963. 


Hallet, S. J. Planning, politics and ethics. In W. R. Ewald Jr. (Ed.), 
Environment for man. Bloomington: Indiana University Press, 
1967. 


Harris, B. (Ed.) Urban development models: new tools for planning. Journal 
of the American Institute of Planners, 1965, 31. 


Heilbroner, R. L. The future as history. New York: Harper, 1959. 


129 


Hofstadter, R. Social Darwinism in American thought. (Rev. ed.) Boston: 
Beacon Press, 1955. 


Homans, G. C. The human group. New York: Harcourt, Brace and World, 
1950. 


Housego, I. E. Democratic decision making in education. Canadian 
Administrator, 1965, 4. 


Hughes, E. C. The ecological aspect of institutions. American Sociological 
Review, 1936, 1. 


Isler, M. L. Selecting data for community renewal programming. Journal of 
the American Institute of Planners, 1967, 33. 


Jackson, J. M. Reference group processes in a formal organization. 
Sociometry, 1959, 22. 


Jay, A. Management and Machiavelli. New York: Rinehart & Winston, 1967. 


Jasinski, F. J. Adapting organization to new technology. In E. A. Fleishman 
(Ed.), Studies in personnel and industrial psychology. Homewood, 
Ill.: The Dorsey Press, 1961. 


Jones, H. W. The rule of law and the welfare state. Columbia Law Review, 
1958, 58. 


Kahn, A. J. Theory and practice of social planning. New Y ork: Russell Sage 
Foundation, 1969. 


Kaplan, A. On the strategy of social planning. Unpublished papers, 
mimeographed, 1958. 


Kimbrough, R. B. Political power and educational decision-making. 
Chicago: Rand-McNally, 1964. 


Kornhauser, A. and others (Eds.) Jndustrial conflict. New York: 
McGraw-Hill, 1954. 


Kuusi, P. Social policy for the sixties. Helsinki, Finland: Finnish Social 
Policy Association, 1964. 


Lampman, R. How much does the American system of transfers benefit the 
poor. In L. H. Goodman (Ed.), Economic progress and social 
welfare. New York: Columbia University Press, 1966. 


Landsberger, H. A. Interaction process analysis of the mediation of labor 
management disputes. Journal of Abnormal and Social Psychology , 
1955; 51. 


Lawrence, P. R. The changing of organizational behavior patterns. Boston, 
Harvard Business School Division of Research, 1958. 


Leavitt, H. J. (Ed.) The social science of organizations: four perspectives. 
Englewood Cliffs: Prentice-Hall, 1963. 


130 


LeBreton, P. P. and Henning, D. A. Planning theory. Englewood Cliffs: 
Prentice-Hall, 1961. 


Lecht, L.A. Goals, priorities and dollars. New Y ork: Free Press, 1966. 


Lester, R. A. Manpower planning in a free society. Princeton: Princeton 
University Press, 1966. 


Levine, S. and White, P. E. Exchange as a conceptual framework for the 
study of interorganizational analysis. Administrative Science 
Quarterly, 1951, 5. 


Lindblom, C.E. The rediscovery of the market. The Public Interest, 1966, 1. 
bi 


Lindblom, C. E. The intelligence of democracy. New York: Free Press, 
1968. 


Litwak, E. & Hylton, L. F. Interorganizational analysis: a hypothesis on 
coordinating agencies. Administrative Science Quarterly, 1961, 6. 


Mack, R. Planning on uncertainty. New Y ork and Washington: Resources for 
the Future and the Institute of Public Administration, 1969. 


Mainer, R. The impact of strategic planning on executive behavior. 
Published in 1965 by Boston Safe Deposit and Trust Company. 


Mangum, G. L. (Ed.) The manpower revolution: its policy consequences. 
Garden City: Doubleday, 1965. 


Marris, P. & Rein, M. Dilemmas of social reform. New York: Atherton Press, 
POG) 


Marshall, T. H. Class, citizenship and social development. New York: 
Doubleday, 1965. 


Marshall, T. H. Social policy. London: Hutchinson University Library, 
L965: 


McMillen, W. Community organization for social welfare. Chicago: 
University of Chicago Press, 1945. 


Mencher, S. Current priority planning. Social Work, 1964, 9. 


Mencher, S. Poor law to poverty program: economic security policy in 
Britain and the United States. Pittsburgh: University of Pittsburgh 
Press, 1967. 


Merton, R. K. The role set: problems on sociological theory. British Journal 
of Sociology, 1957, 8. 


Merton, R.K. Social theory and social structure, Glencoe: Free Press, 1957. 


Merton, R. K. and others (Eds.) Readers in bureaucracy. Glencoe: Free 
Press, 1952. 


131 


Morgan, J. S. (Ed.) Welfare and wisdom. Toronto: University of Toronto 
Press, 1966. 


Morris, R. (Ed.) Centrally planned change: prospects and concepts. New 
York: National Association of Social Workers, 1964. 


Moynihan, D. The relationship of federal to local authorities. In Toward the 
Year 2000. A special issue of Deadalus, 1967, 96. 


Munger, M. and others. Decisions in Syracuse: metropolitan action studies, 
number one. Bloomington: Indiana University Press, 1961. 


National Commission on Technology, Automation and Economic Progress. 
Technology and the American economy. Washington, D.C.: 
Government Printing Office, 1966. 


Northwood, L. K. Urban development in the United States: implications for 
social welfare. New York: U.S. Committee of the International 
Conference of Social Work, 1966. 


Novick, D. (Ed.) Program budgeting. Cambridge: Harvard University Press, 
L965; 


Ohlin, L. Prospects for planning in American social welfare. In R. Morris 
(Ed.), Centrally planned change: prospects and concepts. New 
York: National Association of Social Workers, 1964. 


Organization for Economic Cooperation and Development. Social objectives 
in educational planning. Paris: OECD, 1967. 


Organization for Economic Cooperation and Development. Organizational 
problems in planning educational development. Paris: OECD, 
1966. 


Peattie, L. R. Reflections on advocacy planning. Journal of the American 
Institute of Planners, 1968, 34. 


Perlman, R. Social welfare planning and physical planning. Journal of the 
American Institute of Planners, 1966, 34. 


Perloff, H. New directions in social planning. Journal of the American 
Institute of Planners, 1965, 31. 


Perloff, H. Social planning in the metropolis. In L. J. Duhl (Ed.), The urban 
condition. New York: Basic Books, 1963. 


Popenoe, D. Community development and community planning. Journal of 
the American Institute of Planners, 1967, 33. 


Polanyi, K. The great transformation. Boston: Beacon Press, 1957. 


Quinn, J. B. Top management guides for research planning. In J. R. Bright 
(Ed.), Technological planning on the corporate level. Boston: 
Harvard Business School, 1962. 


132 


Rein, M. Social science and the elimination of poverty. Journal of the 
American Institute of Planners, 1967, 33. 


Rein, M. and Miller, S. M. Poverty, policy and purpose: the dilemmas of 
choice. In L. H. Goodman (Ed.), Economic progress and social 
welfare. New York: Columbia University Press, 1966. 


Riffel, J. A. Cooperative Decision Making in Education; unpublished 
master’s thesis, University of Saskatchewan, 1967. 


Rogers, E.S. Human ecology and health. New Y ork: Macmillan, 1960, 


Root, E. L. and Steiner, G. A. The Lockheed Aircraft Corporation master 
plan. In D. W. Ewing (Ed.), Long-range planning for management. 
New York: Harper, 1964. 


Rose, A. Voluntary association under conditions of competitions and 
conflict. Social Forces, 1955, 34. 


Rose, A. (Ed.) Human behavior and social processes. Boston: Houghton 
Mifflin, 1962. 


Ross, M. Community organization: theory and principles. New York: 
Harper, 1955. 


Rossi, P. H. and Dentler, R. A. The politics of urban renewal. Glencoe: Free 


Press, 1961. 
Rostow, E. V. Planning for freedom. New Haven: Yale University Press, 
1962: 


Rowat, D. C. The ombudsman. London: George Allen and Unwin, 1965S. 


Schlesinger, A. M. Jr. The crisis of the old order. Boston: Houghton Mifflin, 
eye 


Seeley, J. R. Central planning: prologue to a critique. In R. Morris (Ed.), 
Centrally planned change: prospects and concepts. New York: 
National Association of Social Workers, 1964. 


Shaw, M. E. and others. Decision process in communication nets. Journal of 
Abnormal and Social Psychology, 1957, 54. 


Sherif, M. Superordinate goals in the reduction of intergroup conflict. 
American Journal of Psychology, 1958, 63. 


Shonfield, A. Modern capitalism: the changing balance of public and private 
power. New York: Oxford University Press, 1965. 


Shure, G. H., Rogers, M. S., Larsen, I. M., and Tassone, J. Group planning 
and task effectiveness. Sociometry, 1964. 


Siegal, S. and Fouraker, L. E. Bargaining and group decision-making: 
experiments in bilateral monopoly. New York: McGraw-Hill, 1960. 


b33 


Simon, H. A. The new science of management decision. New Y ork: Harper, 
1960. 


Sirkin, G. (Ed.) The visible hand: the fundamentals of economic plannning. 
New York: McGraw-Hill, 1968. 


Sloan, A. P. Jr. My years with General Motors. Garden City: Doubleday, 
1964. 


Smelser, N. J. A comparative view of exchange systems. Economic 
Development and Cultural Change, 1959, 7. 


Smelser, N. J. Theory of collective behavior. London: Routledge and Kegan 
Paul, 1962. 


Smithies, A. Conceptual framework for the program budget. In D. Novick 
(Ed.), Program budgeting. Cambridge: Harvard University Press, 
1965. 


Soule, G. Planning U.S.A. New York: Viking Press, 1967. 


Stein, H. D. (Ed.) Planning for the needs of children in developing countries. 
New York: United National Children’s Fund, 1965. 


Stohr, W. Planning for depressed areas: a methodological approach. Journal 
of the American Institute of Planners, 1964, 30. 


Strother, G. B. (Ed.) Social science approaches to business behavior. 
Homewood: Dorsey Press and Richard D. Irwin, 1962. 


Suchman, E. A. Evaluative research. New York: Russell Sage Foundation, 
1968. 


Tannenbaum, A. S. Control and effectiveness in a voluntary organizaton. 
American Journal of Sociology, 1961, 67. 


Terrien, F. W. and Mills, D. L. The effect of changing size upon the internal 
structure of organizations. American Sociological Review, 1955, 
20. 


Thompson, J. D. and McEwen, W. J. Organizational goals and environment: 
goal-setting as an interaction process. American Sociological 
Review, 1958, 32. 


Thompson, S. How companies plan. New York: American Management 
Association, 1962. 


Thompson, W. R. Toward a framework for urban public management. In S. 
B. Warner (Ed.), Planning for a nation of cities. Cambridge: M.I.T. 
Press, 1966. 


Tinbergen, J. Social aspects of economic planning. In Social progress 
through social planning — the role of social work. Proceedings of 
the 12th International Conference of Social Work. Athens, New 
York: International Conference of Social Work, 1965. 


134 


Tinbergen, J. Central planning. New Haven: Yale University Press, 1964. 


Titmuss, R. M. Problems of social policy. London: His Majesty’s Stationery 
Office and Longmans, Green, 1950. 


Titmuss, R. M. Commitment to welfare, New York: Pantheon Books, 1968. 


Titmuss, R. M. The role of redistribution in social policy. Social Security 
Bulletin, 1965, 28. 


Udy, S. H. Jr. Administrative rationality, social setting, and organizational 
development. In W. W. Cooper and others (Eds.), New perspec tives 
in organization research. New Y ork: Wiley, 1964. 


United Nations. Report on the world situation. New York: Author, 1961. 


United Nations. Towards a dynamic development policy for Latin America. 
New York: Author, 1963. 


United Nations Department of Economic and Social Affairs. Planning for 
balanced social and economic development: six country case 
studies. New York: Author, 1964. 


Unesco. Educational planning: a survey of problems and prospects. Paris: 
Author, 1963. 


Unesco. Methods of determining social allocations. New York: Author, 
1965. 


Vancil, R. F. So you’re going to have a planning department? Harvard 
Business Review, 1967. 


Warren, R. L. The community in America. Chicago: Rand, McNally, 1963. 


Waterston, A. Development planning. Baltimore: Johns Hopkins Press, 
1965. 


Wheeler, H. The restoration of politics. An occasional paper of the free 
society, Santa Barbara, California. Center for the Study of 
Democratic Insitutions, 1965. 


Wildavsky, A. The politics of the budgetary process. Boston: Little, Brown, 
1964. 


Wilensky, H. L. Organizational intelligence. New York: Basic Books, 1967. 


Wiles, P.J.D. Some fundamental questions on national planning. In B. Gross 
(Ed.), Action under planning. New York: McGraw-Hill, 1967. 


Wilson, J. A. The bureaucracy problem. 7he Public Interest, 1967, 5. 


Wrapp, H. E. Good managers don’t make policy decisions. Harvard Business 
Review, 1967, 45. 


Zaleski, E. Planning reforms in the Soviet Union 1962-1966. Chapel Hill: 
University of North Carolina Press, 1967. 


135 


Zappa, G. Social planning and economic planning: similarities and 
differences. In United Nations, The problems and methods of 
social planning. Report of the Expert Group, Dubrovnik, 
November, 1963. 


CHAPTER FOUR 


The Design and Evaluation of Information Systems 


Allen, T. J. & Gertsburger, P. G. Criteria for selection of an information 
source. Cambridge: Massachusetts Institute of Technology, Alfred 
P. Sloan School of Management, 1967. Working paper 284-67. 


Boehm, B. W. Keeping the upper hand in the man-computer partnership. 
Santa Monica: RAND Corporation, 1967. Report No. P-3533. 


Borko, H. Design of information systems and services. In C. A. Cuadra 
(Ed.), Annual review of information science and technology (Vol. 
2). New York: Interscience, 1967. 


Bourne, C. P., G. D. Peterson, B: Lefkourtz, and D. Ford Requirements, 
criteria, measures of performance of information storage and 
retrieval systems. Menlo Park, California: Stanford Research 
Institute, 1961. 


Brown, G. W. An interuniversity information network. In A. Kent, O. E. 
Talbee, J. Belzer, and G. D. Goldstein (Eds.), Electronic handling 
of information: testing and evaluation. Washington, D. C-.: 
Thompson. London: Academic Press, 1967. 


Calingaert, P. System performance evaluation: survey and appraisal. 
Communication of the Association for Computing Machinery, 
1967.10. 


Cavanaugh, J.M.A. Some considerations relating to user-system interaction 
in information retrieval systems. In A. B. Tonik (Ed.), Information 
retrieval: the user’s viewpoint, an aid to design. Philadelphia: 
International Information, Incorporated, 1967. 


Center for Educational Research and Innovation. S.O.M. A Simulation 
Model of the Educational System. Technical Report. Paris: 
Organization for Economic Cooperation and Development, 1970. 


Cuadra, C. A. and R. V. Kalter. The relevance of relevance assessment. In 
Proceedings of the 30th Annual Meeting of the American 
Documentation Institute. Washington, D.C.: Thompson, 1967. 


Dugger, E. and R. F. Klinger. User evaluation of information services. In A. 
B. Tonik (Ed.), Information retrieval: the user’s viewpoint, an aid 
to design. Philadelphia: International Information, Incorporated, 
1967. 


136 


Economic Council of Canada. Conference on Government Information 
Systems. Ottawa: Queen’s Printer, 1968. 


Emery, J. Economics of information. Presented at International Systems 
Meeting, Detroit, Michigan, October, 1967. 


Fairthorne, R. A. Morphology of information flow. Journal of the 
Association for Computing Machinery, 1967, 14. 


Fanswick, C. Caveat emptor systematibus - let the buyer of systems beware. 
Santa Monica: System Development Corporation, 1967. SP-2900. 


Glaser, E., D. Rosenblatt, and M. K. Wood. The design of a federal statistical 
data center. American Statistician, 1967, 21. 


Goffman, W. and V. Newill. A methodology for test and evaluation of 
information retrieval systems. /nformation Storage and Retrieval, 
196 7,3. 


Good, I. J. The decision — theory approach to the evaluation of information 
retrieval systems. Information Storage and Retrieval, 1967, 3. 


Henderson, M. M. Evaluation of information systems: a_ selected 
bibliography with information abstracts. (NBS technical note 297) 
Washington, D. C.: National Bureau of Standards, Technical 
Information Exchange, Center for Computer Sciences and 
Technology, 1967. 


Hirshleifer, J. Notes of the private and social value of information. (Report 
No. W. M. S. 1 Working Paper - 114) Los Angeles: University of 
California, Western Management Science Institute, 1967. 


Jones, R. D. User-designed retrieval indices: a case study. In A. B. Tonik 
(Ed.), Information retrieval: the user’s viewpoint, an aid to design. 
Philadelphia: International Information Incorporated, 1967. 


Keen, E. M. User-controlled search strategies. In A. B. Tonik (Ed.), 
Information retrieval: the user’s viewpoint, an aid to design. 
Philadelphia: International Information Incorporated, 1967. 


Kent, A. Centralization, decentralization and specialization — a problem in 
resource allocation. In A. Kent, O. E. Talbee, J. Belzer, and G. D. 
Goldstein, (Eds.), Electronic handling of information: testing and 
evaluation. Washington, D. C.: Thompson; London: Academic 
Press, 1967. 


Kraemer, K. L. The evolution of information systems for urban 
administration. Public Administration Review, 1969, 29. 


Limberg, H. How to meet management’s information needs. Presented at 
the International Systems Meeting, Detroit, Michigan, October 14, 
1967. 


137 


McCracken, M. C. Data Administration in an information system. In 
Economic Council of Canada, Conference on Government 
Information Systems. Ottawa: Queen’s Printer, 1968. 


Nance, R. E. Systems analysis and the study of information systems. In 
Proceedings of the 30th Annual Meeting of the American 
Documentation Institute, New York, October, 1967. 


Neeland, F. A bibliography on information science and technology. Parts 
I-IV: 1966, TM-3008/001/00; . TM-3008/002/00; 
TM-3008/003/00; TM-3008/004/00. Parts I-IV: 1967, TM 
(L)-3553/001/00; TM (L)-3553/002/00; YM (L)-3553/003/00; TM 
(L)-3553/004/00. Santa Monica: System Development 
Corporation, 1966. 


Rees, A. M. Evaluation of information systems and services. In C. A. 
Cuadra, Annual review of information science and technology. 
New York: Interscience; 1967. 


Schwartz, B. The role of analysis in educational planning. Paris: 
Organization of Economic Cooperation and Development, 1970. 


Schwartz, M. H. The administrator and the computer: rights and 
responsibilities. In Economic Council of Canada, Conference on 
Government Information Systems. Ottawa: Queen’s Printer, 1968. 


Shirey, D. L. and M. Kurfeerst. Relevance predictability II: data reduction. 
In A. Kent, O. E. Talbee, J. Belzer and G. D. Goldstein (Eds.), 
Electronic handling of information: testing and _ evaluation. 
Washington, D. C.: Thompson; London: Academic Press, 1967. 


Swanson, R. A. Information system networks — let’s profit from what we 
know. In G. Schecter (Ed.), Information retrieval — a critical view. 
Washington, D. C.: Thompson, 1967. 


Talbee, O. E. An approach to comprehensive evaluation. In A. Kent, O. E. 
Talbee, J. Belzer and G. D. Goldstein (Eds.), Electronic handling of 
information: testing and evaluation. Washington, D.C.: Thompson, 
London: Academic Press, 1967. 


Treu, S. Testing and evaluation — literature review. In A. Kent, O. E. 
Talbee, J. Belzer, and G. D. Goldstein (Eds.), Electronic handling 
of information: testing and evaluation. Washington, D.C.: 
Thompson; London: Academic Press, 1967. 


Welch, J. T. Jr. Measures and criteria for evaluation. In A. Kent, O. E. 
Talbee, J. Belzer, and G. D. Goldstein (Eds.), Electronic handling 
of information: testing and evaluation. Washington, D.C.: 
Thompson; London: Academic Press, 1967. 


Whitlock, J. W. Automatic data processing in education. New York: 
Macmillan, 1964. 


138 


~Yovits, M. C. and R. L. Ernst. Generalized information systems. In A. Kent, 
O. E. Talbee, J. Belzer and G. D. Goldstein (Eds.), Electronic 
handling of information: testing and evaluation. Washington, D.C.: 
Thompson; London: Academic Press, 1967. 


Data Banks 


Adler, H. J. The current Canadian time series data bank. Conference on 
Government Information Systems. Economic Council of Canada, 
Ottawa, October 5-6, 1967. Ottawa: Queen’s Printer, 1968. 


Almendinger, V. U. Span: a system for urban data management. Urban 
information and policy decisions, (Ed.), C. D. Rogers. Selected 
papers from the Second Annual Conference on Urban Planning 
Information Systems and Programs, September 24-26, 1964, 
University of Pittsburgh. 


Becker, J. Information storage and retrieval: the field. International 
encyclopedia of the social sciences, (Ed.), D. L. Sills. Glencoe: Free 
Press, 1968. 


Bisco, R. L. Social science data archives: progress and prospects. Social 
Science Information, 1967, 6. 


Borko, H. and L. B. Doyle. The changing horizon of information storage 
and retrieval. American Behavioral Scientist, 1964, 7. 


Bowman, R. T. Crossroad choices for the future development of the federal 
statistical system. Journal of the American Statistical Association, 
1968, 63. 


Converse, P. E. A network of data archives for the behavioral sciences. The 
Public Opinion Quarterly, 1964, 28. 


Douglas, A. S. The impact of computers on documentation. The Computer 
Journal, 1961, 4. 


Drutz, A. The problems of hardware and software (or how you can learn to 
live with the computer). Conference on Government Information 
Systems. Economic Council of Canada, Ottawa, October, 5-6, 
1967, Ottawa: Queen’s Printer, 1968. 


Ferguson, J. and P. F. Lazarfeld. Social science information services: 
progress report on a survey. The American Behavioral Scientist, 
1964, 7. 


Gale, L. A. Recommendations on the type of coordinate system for 
correlating files in a data bank system. Paper presented at 
Symposium on land registration and data banks. Fredericton, New 
Brunswick: The University of New Brunswick, November 13-15, 
1968. 


139 


Gueuther, R. K. Data processing and simulation techniques. Department of 
City Planning, Pittsburgh, Pennsylvania, October, 1962. 


Hastings, P. K. The proper public opinion research center: an international 
archive of social science data. /nternational Social Science Journal, 
1964, 16. 


Horwood, E. M. A fundamental look at urban information systems. In C. D. 
Rogers (Ed.), Urban information and policy decisions. Selected 
papers from the Second Annual Conference on Urban Planning 
Information Systems and Programs, September 24-26, 1964, 
University of Pittsburgh. 


Kent, A. Specialized information centers: their role, function and design. 
In C. D. Rogers (Ed.), Urban information and policy decisions. 
Selected papers from the Second Annual Conference on Urban 
Planning Information Systems and Programs, September 24-26, 
1964, University of Pittsburgh. 


Krotki, K. J. Existing and suggested data banks: population statistics. Paper 
prepared for the Symposium on Land Registration and Data Banks. 
Fredericton, New Brunswick: The University of New Brunswick, 
November 13-15, 1968. 


Krotki, K. J. Availability and retrieval of regional data in Canada. In B. Y. 
Card (Ed.), Perspectives on regions and regionalism. Western 
Association of Sociology and Anthropology Proceedings, Banff, 
Alberta, December 28-30, 1968. Edmonton, Alberta: University of 
Alberta Bookstore, 1969. 


Lennox, M. and T. J. Vander Nout. Introduction to the Canadian 
socio-economic information management system (CANSIM). 
Canadian Statistical Review, 1969, 44. 


Levy, F. Information storage and retrieval in the social sciences. In S. 
Rokkan (Ed.), Data archives for the social sciences. The 
International Social Science Council, Paris (The Hague): Mouton, 
1966. 


McCracken, M. C. Data administration in an information system. 
Conference on Government Information Systems. Economic 
Council of Canada, Ottawa, October 5-6, 1967. Ottawa: Queen’s 
Printer, 1968. 


Merritt, R. L. and R. E. Lane. The training functions of a data library. 
Social Sciences Information, 1965, 4. 


Mitchell, R. E. Information storage and retrieval information services. 
International Encyclopedia of the Social Sciences, D. C. Sills, 
(Ed.). Glencoe: Free Press, 1968. 


140 


Rokkan, S. Archives for secondary analysis of sample survey data: an early 
inquiry into the prospects for Western Europe. /nternational Social 
Science Journal, 1964, 16. 


Salton, G. Automatic information organization and retrieval. New York: 
McGraw-Hill, 1968. 


Scheuch, E. K. and I. Bruning. The Zentralarchiv at the University of 
Cologne. International Social Science Journal, 1964, 16. 


Simpson, G. S. Jr., and C. Flanagan. Information centers and services. In C. 
A. Cuadra, (Ed.), Annual review of information science and 
technology. New York: Wiley, 1966. 


Smith, C. R. Computer developments from a user’s point of view. The 
Computer Journal, 1964, 7. 


U.S. Department of Health, Education and Welfare. The common core of 
state educational information. Washington, D.C.: Government 
Printing Office, 1953. 


Weldon, J. I. Data storage and retrieval. Paper presented at the Sixty-First 
Annual Meeting of the Canadian Institute for Surveyors. 
Edmonton, Alberta, 1968. 


Social Indicators 
Aronoff, J. Psychology needs and cultural system. Princeton: Van Nostrand, 
1967. 
Bauer, R. A. (Ed.) Social indicators. Cambridge: M.I.T. Press, 19606. 


Bay, C. The structure of freedom. California: Stanford University Press, 
1958. 


Becker, E. Beyond alienation. New York: George Brazillier, 1967. 


Durkheim, E. The elementary forms of religious life. New York: Macmillan, 
POLS. 

Educational Policy Research Center. Toward master social indicators. 
Stanford Research Institute, 1969. 


Erikson, E. H. Growth and crises of the healthy personality. In C. 
Kluckhohn and others (Eds.), Personality in nature, society and 
culture. New York: Knopf, 1953. 


Etzioni, A. and E. Lehman. Some dangers of valid social measurement. In 
the Annals of the American Academy of Political and Social 
Science, September, 1967. 


Etzioni, A. The active society. London: Collier-Macmillan, 19068. 


Goals for Americans. The report of the President’s Commission on National 
Goals, Spectrum Books, 1962. 


141 


Goldwater, B. The conscience of a conservative. New York: McFadden 
Books, 1964. 


Gross, B. M. The state of the nation. London: Tavistock, 1966. 


Hagen, E. E. On the theory of social change. Homewood, Ill.: Dorsey Press, 
1962. 


Kluckhohn, C. and others. Values and value orientations in the theory of 
action. In T. Parsons and E. L. Shils (Eds.) Toward a general theory 
of action. Cambridge: Harvard University Press, 1951. 


Lewis, C. L. An analysis of knowledge and valuation. The Paul Carus 
Foundation Lectures VII, LaSalle, Ill.: Open Court Publishing, 
1946. 


Maslow, A. H. Motivation and personality. New York: Harper, 1954. 
McClelland, D. Personality. New York: Holt, Rinehart and Winston, 1951. 
Moore, W. E. Social change. Englewood Cliffs: Prentice-Hall, 1963. 


Suchman, E. A. Evaluative research. New York: Russell Sage Foundation, 
1967. 


Tiryakian, E. A. A model of societal change and its lead indicators. In S. 
Klausner (Ed.), The study of total societies. Garden City, New 
York: Doubleday, 1967. 


U. S. Department of Health, Education and Welfare. Toward a social report. 
Washington, D.C.: U.S. Government Printing Office, 1969. 


Educational Accounts 


Beymer, L. The pros and cons of the national assessment project. Clearing 
House, May, 1966. 


CAPS Capsule. The national assessment of educational progress: concept 
and organization. CAPS Capsule, 1970, 3. 


Finley, C. J. National assessment — Spring 1968. California Journal of 
Educational Research, 1969, 3. 


Fischer, J. H. The question of control. Proceedings of the 1965 Invitational 
Conference on Testing Programs. Princeton: Educational Testing 
Service, 1966. 


Higgins, M. J. and J. C. Merwin. Assessing the progress of education — a 
second report. Phi Delta Kappan, April, 1967. 


Kock, R. National assessment of educational progress — a diffusion study. 
School and Society, February, 1969. 


McMorris, R. F. Progress toward assessing progress in education. 
Educational Horizons, Summer, 1968. 


142 


Merwin, J. C. The progress of exploration toward a national assessment of 
education progress. Journal of Educational Measurement, Spring, 
1966. 


Moellenberg, W. P. National assessment: are we ready? Clearing House, 
April, 1969. 


Morrisett, L. N. Educational assessment and the junior college. Junior 
College Journal, March, 1967. 


National assessment — what, why, how. Education Digest, April, 1969. 


The educational product: how .much are students learning? Carnegie 
Quarterly, Spring, 1966. 


Tyler, R. W. The development of instruments for assessing educational 
progress. Proceedings of the 1965 Invitational Conference on 
Testing Problems. Princeton, N. J.: Educational Testing Service, 
1966. 


Tyler, R. W. The objectives and plans for a national assessment of 
educational progress. Journal of Educational Measurement, Spring, 
1966. 


Tyler, R. W. National assessment — some valuable by-products for schools. 
National Elementary Principal, May, 1969. 


CHAPTER FIVE 


Abt Associates. Design for an elementary and secondary cost-effectiveness 
model: volume I model description. Cambridge: Author, 1967. 


Alkin, M. C. Evaluating the cost-effectiveness of instructional programs. 
CSE Report No. 25. Los Angeles: University of California, 1969. 


Allen, R. G. D. Mathematical analysis for economists. London: Macmillan, 
rea): 


Almon, C. Numerical solution of a modified Leontief dynamic system for 
consistent forecasting or indicative planning. Econometrica, 1963, 
31. 


Arrow, K. J. Applications of control theory to economic growth. In 
Mathematics of the Decision Sciences. Providence, Rhode Island: 
American Mathematical Society, 1968. 


Barkin, S. The economic costs and benefits and human gains and 
disadvantages of international migration. The Journal of Human 
Resources, 1967, 2. 


Barna, T. (Ed.) Structural interdependence and economic development. 
Proceedings of an international conference on input-output 
techniques. New York: St. Martin’s Press, 1963. 


143 


Baumol, W. Economic theory and operations analysis. Englewood Cliffs: 
Prentice-Hall, 1965. 


Baumol, W. Input-output analysis. Economic theory and operations 
analysis. Englewood Cliffs: Prentice-Hall, 1961. 


Becker, G. S. Investment in human capital: theoretical analysis. Journal of 
Political Economy, 1962, 70. 


Bellman, R. Dynamic programming. Princeton: Princeton University Press, 
1957. 


Benson, C. S. The economics of public education. Boston: Houghton 
Mifflin, 1961. 


Blanning, R. W. Opportunity cost and effectiveness analysis by simulation. 
Management Science Center, Wharton School of Finance and 
Commerce, University of Pennsylvania. Philadelphia: University of 
Pennsylvania Press, 1967. 


Blaug, M., H. Preston, and A. Ziderman. The utilization of educated 
manpower in industry. London: Oliver and Boyd, 1967. 


Blaug, M. The rate of return on investment in education. In M. Blaug (Ed.), 
Economics of education 1. Oxford: Pergamon Press, 1968. 


Blumen, I., M. Kogan and P. J. McCarthy, The industrial mobility of labor 
as a probability process. Ithaca: Cornell University Press, 1955. 


Borus, M. E. Time trends in the benefits from retraining in Connecticut. 
Proceedings of the Twentieth Annual Winter Meeting. Madison: 
Industrial Relations Research Association, 1968. 


Borus, M. E. A_ benefit-cost analysis of the economic effectiveness of 
retraining the unemployed. Yale Economic Essays, 1964, 4. 


Borus, M. E. The economic effectiveness of retraining the unemployed. 
Federal Reserve Bank, Research Report No. 35, Boston, 1966. 


Bowman, M. J. The human investment revolution in economic thought. 
Sociology of Education, 1966, 39. 


Bowman, M. J. Costing of human resources development. In E. A. G. 
Robinson and J. Vaizey (Eds.), The economics of education: 
proceedings of a conference of the international economic 
association. London: Macmillan, 1966. 


Burkhead, J., T. G. Fox, and J. W. Holland. Input and output in large-city 
high schools. Syracuse: Syracuse University Press, 1967. 


Cain, G. G. and E. W. Stromsdorfer. An economic evaluation of government 
retraining programs in West Virginia. In G. Somers (Ed.), 
Retraining the unemployed. Madison: University of Wisconsin 
Press, 1968. 


144 


Carter, A. P. Incremental flow coefficients for a dynamic input-output 
model with changing technology. In T. Barna (Ed.), Structural 
interdependence and economic development. Proceedings of an 
International Conference on Input-Output Techniques. Geneva, 
September, 1961. New York: St. Martin’s Press, 1963. 


Chamberlain, N. W. Some further thoughts on the concept of human 
capital. In G. G. Somers and W. D. Wood (Eds.), Cost-benefit 
analysis of manpower policies. Kingston: Industrial Relations 
Center, Queen’s University, 1969. 


Churchman, C. W., R. L. Ackoff and E. L. Arnoff. Introduction to 
operations research. New Y ork: Wiley, 1957. 


Corazzini, A. J. Vocational education: a study of benefits and costs. 
Princeton: Industrial Relations Section, Princeton University, 
1966. (mimeographed). 


Cost-benefits analysis of social projects. Report of a meeting held in Rennes, 
France, 27 September - 2 October, 1965, United Nations Research 
Institute for Social Development, Report No. 7. 


Dennison, E. F. Proportion of income differentials among education groups 
due to additional education: the evidence of the Wolfe-Smith 
survey. In J. Vaizey (Ed.), The residual factor and economic 
growth. Paris: OECD, 1964. 


Dennison, E. F. and J. P. Poullier (Eds.) Why growth rates differ: postwar 
experiences in nine western countries. Washington: Brookings 
Institute, 1967. 


Dilley, F. B. Program budgeting in the university setting. The Educational 
Record, 1966, 47. 


Dorfman, R. (Ed.) Measuring benefits of government investments. 
Washington: Brookings Institute, 1965. 


Downey, L. W. The tasks of public education. Chicago: The University of 
Chicago, Midwest Administration Center, 1960. 


Dyer, H. S. The discovery and development of educational goals. 
Proceedings of the 1966 Invitational Conference on Testing 
Problems. Princeton, N.J.: Educational Testing Service, 1967. 


Eckhaus, R. S. Education and economic growth. In S. J. Mushkin (Ed.), The 
economics of higher education. Washington: U.S. Department of 
Health, Education and Welfare, Office of Education, 1962. 


Eckstein, O. Water-resource development: the economics of project 
evaluation. Cambridge: Harvard University Press, 1965. 


145 


Eckstein, O. A survey of the theory of public expenditure criteria. In J. M. 
Buchanan (Ed.), Public finances: needs, sources and utilization. 
Princeton: Princeton University Press, 1961. 


Enthoven, A. C. The simple mathematics of maximization. Santa Monica: 
RAND Corporation, 1960. 


Farrar, D. E. The investment decision under uncertainty. Englewood Cliffs: 
Prentice-Hall, 1962. 


Fisher, G. H. The role of cost utility analysis in program budgeting. Santa 
Monica: RAND Corporation, 1964. 


Fox, P. D. A theory of cost-effectiveness for military systems analysis. 
Stanford: Stanford Research Institute, 1964. 


Gross, B. The state of the nation. In R. Bauer (Ed.), Social indicators. 
Cambridge: M.I.T. Press, 1966. 


Haavelmo, T. A study of the theory of investment. Chicago: University of 
Chicago Press, 1960. 


Hansen, W. L. Total and private rates of return to investment in schooling. 
Journal of Political Economy, 1963, 81. 


Hansen, W. L. and C. M. Tiebout. An intersectoral flows analysis of the 
California economy. The Review of Economics and Statistics, 
1963, 45. 


Hardin, E. and M. F. Borus. An economic evaluation of the retraining 
program in Michigan: methodological problems of research. 
Proceedings of the 1966 Social Statistics Section Meeting. 
Washington: American Statistical Association, 1966. 


Harkinson, F. H. and C. A. Myers. Manpower and education: country 
studies in economic development. New York: McGraw-Hill, 1965. 


Hartley, H. J. Education planning — programming — budgeting. Englewood 
Cliffs: Prentice-Hall, 1968. 


Heuston, M. C. and G. Ogawa. Observations on the theoretical basis of 


cost-effectiveness. Journal of the Operations Research Society of 
America, 1966, 14. 


Heymont, I., O. Byrk, H. Linstone, and J. Surmeier. Guide for reviewers of 
studies containing cost-effectiveness analysis. Research Analysis 
Corporation, 1965. 


Hirsch, W. Z. Toward federal program budgeting. Santa Monica: RAND 
Corporation, 1966. 


Hitch, C. J. and R. N. McKean. The economics of defense in the nuclear age. 
Cambridge: Harvard University Press, 1967. 


146 


Holland, J. W. Program budgeting and running of educational enterprises. 
School Progress, 1969, 38. 


Isard, W. Regional commodity balances and interregional commodity flows. 
American Economic Review, 1953, 43. 


Isard, W. Some empirical results and problems of regional input-output 
analysis. In W. Leontief, and others (Eds.), Studies in the structure 
of the American economy. New York: Oxford University Press, 
19338: 


James, H. T., T. J. Allen, and» H. J. Dyck. Wealth, expenditure and 
decision-making for education. Stanford: School of Education, 
Stanford University, 1963. 


Johnston, J. Econometric methods. New York: McGraw-Hill, 1963. 


Judy, R. W. Costs: theoretical and methodological issues. In G. G. Somers 
and W. D. Wood (Eds.), Analysis of manpower policies. Kingston: 
Industrial Relations Center, Queen’s University, 1969. 


Judy, R. W. and J. B. Levine. A new tool for educational administrators. 
Toronto: University of Toronto Press, 1965S. 


Kantorovich, L. C. Mathematical methods of organizing and planning 
production. Management Science, 1960, 6. 


Kazanowski, A. D. A standardized approach to cost-effectiveness 
evaluations. In J. M. English (Ed.), Cost-effectiveness. New York: 
Wiley, 1968. 


Kershaw, J. A. and R. N. McKean. Systems analysis and education. Santa 
Monica: RAND Corporation, 1959. 


Knezevich, S. J. Administrative technology and the school executive: 
applying the systems approach to educational administration. 
Washington: American Association of School Administrators, 
1970. 


Lange, O. Introduction to econometrics. New York: Macmillan, 1963. 


Lave, H. J. Cost effectiveness in research and development: observations on 
a case study. Stanford: Stanford Research Institute, 1966. 


Lecht, L. A. Goals, priorities and dollars. New Y ork: Free Press, 1966. 


Leontief, W. Studies in the structure of the American economy. New York: 
Oxford University Press, 1953. 


Leontief, W. The structure of development. Scientific American, 1963, 209. 


Leontief, W., in collaboration with A. Strout. Multiregional input-output 
analysis. In T. Barna (Ed.), Structural interdependence and 
economic development. New Y ork: St. Martin’s Press, 1963. 


147 


Levhari, D. and E. Sheshinski. A theorem on returns to scale and 
steady-state growth. Journal of Political Economy, 1969, 77. 


Levin, H. M. Cost-effectiveness analysis and educational policy — profession, 
confusion, promise. Research and Development Memorandum No. 
41. Stanford: Stanford Center for Research and Development in 
Teaching, Stanford University, 1968. 


Levine, H. S. Input-output analysis and Soviet planning. American 
Economic Review, 1962, 52. 


Lifson, M. W. Value theory. In J. M. English (Ed.), Cost-effectiveness. New 
York: Wiley, 1968. 


Lyle, J. R. Research on achievement determinants in educational systems: a 
survey. Socio-Economic Planning Sciences, 1967, 1. 


MacDonald, J. S. Ideal cost-benefit analysis and practical shortcuts for 
development policy. Presented at meeting of Operations Research 
Society of America, Hawaii, 1964. 


MacDonald, J. S. Discussion: benefits and costs: theoretical and 
methodological issues. In G. G. Somers and W. D. Wood (Eds.), 
Cost-benefit analysis of manpower policies. Kingston: Industrial 
Relations Center, Queen’s University, 1969. 

Marglin, S. The opportunity costs of public investment. Quarterly Journal 
of Economics, 1963, 77. 

Margolis, M. A. Cost analysis: concepts and methods outline. Santa Monica: 
RAND Corporation, 1966. 

Margolis, J. Secondary benefits, external economies, and the justification of 
public investment. Review of Economics and Statistics, 1957, 39. 

Marshall, A. W. and W. H. Meckling. Predictability of the costs, time and 
success of development. Santa Monica: RAND Corporation, 1959. 


McKean, R. N. The use of shadow prices. In S. B. Chase Jr. (Ed.), Problems 
of public expenditure analysis. Washington: Brookings Institute, 
1968. 


McKean, R. N. Efficiency in government through systems analysis. New 
York: Wiley, 1958. 


Miernyk, W. H. The elements of input-output analysis. New Y ork: Random 
House, 1965. 


Miller, R. E. Impact of the aluminum industry on the Pacific Northwest: a 
regional input-output analysis. The Review of Economics and 
Statistics, 1953, 39. 


148 


Miner, J. Financial support for education. In E. L. Morphet and C. E. Ryan 
(Eds.), Implications for education of prospective changes in 
society. New York: Citation Press, 1967. 


Mishan, E. J. Welfare economics: five introductory essays. New York: 
Random House, 1964. 


Mood, A. M. and R. Powers. Cost-benefit analysis of education. Paper 
presented at Washington Operations Research Council’s second 
Cost-Effectiveness Symposium. Washington, March, 1967. 


Morgan, J. and D. Martin. Education and income. The Quarterly Journal of 
Economics, 1963, 77. 


Musgrave, R. The theory of public finance: a study in public economy. New 
York: McGraw-Hill, 1959. 


Novick, D. System and total force cost analysis. Santa Monica: RAND 
Corporation, 1961. 


Novick, D. Which program do we mean in “program budgeting?”’. Santa 
Monica: RAND Corporation, 1964. 


Novick, D. Long-range planning through program budgeting. Business 
Horizons, 1969, 12. 


Orcutt, G. Microanalysis of socioeconomic systems: a simulation study. 
New York: Harper, 1961. 


Orcutt, G. and A. Orcutt. Incentive and disincentive experimentation for 
income maintenance policy purposes. American Economic Review, 
1968, 58. 


Page, D.A. Retraining under the manpower development act: a cost-benefit 
analysis. In J. D. Montgomery and A. Smithies(Eds.), Public policy. 
Cambridge: Graduate School of Public Administration, Harvard 
University, 1964. 


Poindexter, C. C. Evaluation of the educational system. High School 
Journal, 1969, 52. 


Prest, A. R. and R. Turvey. Cost-benefit analysis: a survey. Economic 
Journal, 1965, 75. 


Quade, E. S. Introduction and overview. In T. A. Goldman (Ed.), 
Cost-effec tiveness analysis. New York: F. A. Praeger, 1967. 


Research for Better Schools, Inc. An annotated bibliography of benefits and 
costs in the public sector. Philadelphia: Author, 1968. 


Ribich, T. 1. Education and poverty. Washington: Brookings Institute, 1968. 


Robinson, A. J. and J. Cutt (Eds.) Public finance in Canada: selected 
readings. Toronto: Methuen, 1968. 


149 


Rogers, D. C. Private rates of return to education in the United States: a 
case study. Ph.D. dissertation, Yale University, 1968. 


Rothenberg, J. The measurement of social welfare. Englewood Cliffs: 
Prentice-Hall, 1961. 

Schick, A. The road to PPB: the stages of budget reform. Public 
Adminstration Review, 1966, 26. 


Schlaifer, R. Probability and statistics for business decisions. New York: 
McGraw-Hill, 1959. 


Schultz, T. W. The economic value of education. New York: Columbia 
University Press, 1963. 


Sevaldson, P. Changes in input-output coefficients. In T. Barna, (Ed.), 
Structural interdependence and economic development. New 
York: St. Martin’s Press, 1963. 


Sewell, W. R. D., J. Davis, A. D. Scott, and D. W. Ross. Guide to 
benefit-cost analysis. Ottawa: Queen’s Printer, 1965. 

Shaffer, H. G. Investment in human capital: comment. American Economic 
Review, 1961, 4. 

Sisson, R. L. A model of a school. Philadelphia: Wharton School of Finance 
and Commerce, University of Pennsylvania, 1968. 


Sisson, R. L. Can we model the educational process? Paper presented to 
Symposium on Operations Analysis of Education for U.S. Office of 
Education, Washington, 1967. 


Smithies, A. Government decision-making and the theory of choice. Santa 
Monica: RAND Corporation, 1964. 


Solie, R. J. Employment effects of retraining the unemployed. /ndustrial 
and Labor Relations Review, 1968, 21. 


Stager, D. A. Monetary returns to post-secondary education in Ontario. 
Doctoral dissertation, Princeton University, 1968. 


Starr, R. and J. Carlson. Pollution and poverty: the strategy of 
cross-commitment. The Public Interest, 1968, 10. 


Stevens, B. H. A review of the literature on linear methods and models for 
spatial analysis. Journal of the American Institute of Planners, 
1960, 26. 


Stone, R. /nput-output and national accounts. Paris: Organization for 
Economic Cooperation and Development, 1960. 


Stromsdorfer, E. W. Determinants of economic success in retraining the 
unemployed. Journal of Human Resources, 1968, 3. 


150 


Suchman, E. A. Evaluative research. New York: Russell Sage Foundation, 
1967. 


Taussig, M. K. An economic analysis of vocational education in New York 
City high schools. Journal of Human Resources, 1968, 3. 


Temkin, S. A cost-effectiveness evaluation approach to improving resource 
allocations for school systems. Ph.D. dissertation, University of 
Pennsylvania, 1969. 


Tiebout, C. M. Regional and interregional input-output models: an 
appraisal. The Southern Economic Journal, 1957, 24. 


Tinbergen, J. On the theory of economic policy. Amsterdam: North 
Holland, 1952. 


Treml, V. G. Economic interrelations in the Soviet Union. Annual 
Economic Indicators for the U.S.S.R. Washington, D. C.: US. 
Government Printing Office, 1964. 


Vedder, J. Planning problems with multidimensional consequences. Journal 
of the American Institute of Planners, March, 1970. 


Wadsworth, G. P. and J. G. Bryan. Introduction to probability and random 
variables. New York: McGraw-Hill, 1960. 


Watts, H. W. and D. L. Horner. The educational benefits of head start: a 
quantitative analysis. Discussion Paper Series. Madison: The 
Institute for Research on Poverty, University of Wisconsin, 1968. 


Weil, R. L. Jr. Allocating joint costs. American Economic Review, 1968, 58. 


Weisbrod, B. A. Concepts of costs and benefits. In S. B. Chase, Jr. (Ed.), 
Problems in public expenditure analysis. Washington, D. C.: 
Brookings Institute, 1968. 


Weisbrod, B. A. Conceptual issues in evaluating manpower training 
programs. Monthly Labor Review, 1966, 89. 


Weisbrod, B. A. Expenditures on human resources: investment income 
redistribution or what. In Federal programs for the development of 
human resources, vot. 1. Washington, D.C.: Joint Economic 
Committee, U.S. Congress, 1968. 


Weisbrod, B. A. Preventing high school dropouts. In R. Dorfman (Ed.), 
Measuring benefits of government investment. Washington, D.C.: 
Brookings Institute, 1965. 

Wildavsky, A. The political economy of efficiency: cost-benefit analysis, 
systems analysis, and program budgeting. Public Administration 
Review, 1966, 26. 


Wilkinson, B. W. Studies in the economics of education. Occasional paper 
no. 4, Department of Labor. Ottawa: Queen’s Printer, 19606. 


15] 


Winkler, R. L. The quantification of judgement: some methodological 
suggestions. Journal of the American Statistical Association, 1967, 
62. 


Wood, W. D., and G. G. Somers. Forward. In G. G. Somers and W. D. Wood 
(Eds.), Cost-benefit analysis of manpower policies. Kingston: 
Industrial Relations Center, Queen’s University, 1969. 


CHAPTER SIX 


Abt, C. C. Public participation in future: forecasting and planning. World 
Future Society, 1967. 


Adelsen, M. The technology of forecasting and the forecasting of 
technology. Santa Monica: System Development Corporation, 
1968. 


Allsopp, B. The future of the arts: a study. London: Pitman, 1959. 


Almon, C. Jr. The American economy to 1975: an interindustry forecast. 
New York: Harper, 1966. 


American Society of Planning Officials. Thresholds of planning information 
systems. Chicago: Author, 1967. 


Anderson, S. /nventing the future environment. Cambridge: M.I.T. Press, 
1966. 


Anderson, S. (Ed.) Planning for diversity and choice. Cambridge: M.I.T. 
Press, 1968. 


Anshen, M. and G. L. Bach. Management and corporations 1985. New 
York: McGraw-Hill, 1960. 

Asimov, I. [s anyone there? New York: Doubleday, 1969. 

A survey of current literature on automation and other technological 
changes: a_ selected annotated bibliography. Committee on 


Education and Labor, House of Representatives. Washington, 
D. C.: U.S. Government Printing Office, 1964. 


Ayres, R. V. Technological forecasting and long-range planning. New Y ork: 
McGraw-Hill, 1969. 


Baade, F. The race to the year 2000. Translated by E. Pawel. New York: 
Doubleday, 1962. 


Baier, K. and N. Rescher (Eds.) Values and the future. New York: Free 
Press, 1969. 


Barach, A. B. 1975 and the changes to come. New York: Harper, 1962. 
Bates, M. Expanding population in a shrinking world. New Y ork: American 


Library Association, 1963. 


pees 


Bauer, R. A. (Ed.) Social indicators. Cambridge: M.I.T. Press, 1966. 


Bell, D. (Ed.) Commission on the year 2000: work in progress. Boston: 
Houghton-Mifflin, 1968. 


Bell, D. Notes on the post industrial society. The Public Interest, 1967, 6. 
Bell, D. The end of ideology. New York: Free Press, 1960. 
Bell, D. Twelve modes of prediction. Daedalus, 1964, 93. 


Bellamy, E. Looking backward: 2000-1887. Cambridge: University of 
Harvard Press, 1967. 


Bellamy, E. As cities grow. Canadian Welfare, 1967, 43. 


Bisco, R. L. Social science data archives: progress and prospects. Social 
Science Information, 1967, 6. 


Bloomsfield, L. Western Europe in the mid 70’s: scenarios. Cambridge: 
M.I.T. Press, 1968. 


Boguslaw, R. The new utopians: a study of system design and social change. 
Englewood Cliffs: Prentice-Hall, 1965. 


Borko, H. and L. B. Doyle. The changing horizon of information storage 
and retrieval. American Behavioral Scientist, 1964, 7. 


Boulding, K. E. The boundaries of social policy. Social Work, 1967, 12. 


Boulding, K. E. The meaning of the twentieth century: the great transition. 
Evanston: Harper, 1964. 


Bowen, H. R. and G. Mangum (Eds.) Automation and economic progress. 
Englewood Cliffs: Prentice-Hall, 1966. 


Brown, H. The challenge of man’s future. New York: Viking Press, 1954. 
Brown, H. The next hundred years. New York: Viking Press, 1957. 
Bryson, L. The next America. New York: Harper, 1952. 


Burke, J. G. (Ed.) The new technology and human values. Belmont, 
California: Wadsworth Publishing, 1966. 


Calder, N. Technopolis. London: MacGibbon and Kee, 1969. 


Calder, N. (Ed.) The world in 1984. Vols. 1 and 2. Baltimore: Penguin 
Books, 1965. 


Calder, N. (Ed.) Unless peace comes: a scientific forecast of new weapons. 
New York: Viking Compass, 1969. 


Calleo, D. Britain’s future. London: Hodder and Stoughton, 1969. 
Chalmers, W. S. and R. S. Isevson. Project hindsight. Science, 1967, 23. 
Chase, E. T. The shape of things to come. The New Republic, 1965, 153. 
Cheydleur, B. F. Information retrieval - 1996. Datamation, 1961, 7. 


153 


Clarke, A. C. Profiles of the future. New York: Harper, 1967. 


Clarke, A. C. The challenge of the spaceship: previews of tomorrow’s world. 
New York: Harper, 1959. 


Conkin, P. Tomorrow a new world. Ithaca: Cornell University Press, 1959. 


Cross, G. L. The world of ideas: essays on the past and future. Norman: 
University of Oklahoma Press, 1969. 

Dalkey, N. and O. Helmer. An experimental application of the Delphi 
method to the use of experts. Management Sciences, 1963, 9. 


de Jouvenel, B. Futuribles. Santa Monica: RAND Corporation, 1965. 
de Jouvenel, B. The art of conjecture. New York: Basic Books, 1967. 
de Riencourt, A. The coming Caesars. New York: Capricorn Books, 1964. 


Determinants and consequences of population trends. Population Division, 
Statistical Office, Department of Social Affairs, United Nations, 
New York, 1953. 


Dror, Y. Muddling through — science or inertia. Public Administration 
Review, 1964, 23. 


Dror, Y. Public policy making re-examined. San Franscisco: Chandler, 1968. 
Drucker, P. America’s next twenty years. New York: Harper, 1957. 


Drucker, P. The new society: the anatomy of industrial order. New York: 
Harper, 1962. 


Dumazedier, J. Towards a society of leisure. New York: Free Press, 1967. 


Duncan, O. D. From social system to ecosystem. Sociological Inquiry, 1961, 
31. 


Duncan, O. D. Social stratification and mobility: problems in the 
measurement of trend. In E. B. Sheldon and W. E. Moore (Eds.), 
Indicators of social change. New York: Russell Sage Foundation, 
1968. 


Duncan, O. D. Social forecasting — the state of the art. The Public Interest, 
L969. 


Dunlop, J. T. (Ed.) Automation and technological change. Englewood 
Cliffs: Prentice-Hall, 1962. 


Dunstan, M. and P. W. Garlan. Worlds in the making. Englewood Cliffs: 
Prentice-Hall, 1969. 


Economic Commission for Africa (U.N.). Some problems of social 
development planning in relation to economic development. 
Economic Bulletin for Africa, Addis Ababa, 1962, 11. 


Ellul, J. The technological society. Translated by J. Wilkinson. New York: 
A.A. Knopf, 1964. 


154 


Eurich, A. C. (Ed.) Campus 1980: the shape of the future in American 
higher education. New Y ork: Delacorte, 1969. 


Fabricant, S. Measurement of technological change. Washington, D.C.: U.S. 
Government Printing Office, 1965S. 


Fabun, D. The dynamics of change. Englewood Cliffs: Prentice-Hall, 1966. 


Feinberg, G. The Prometheus project: mankind’s search for long-range goals. 
New York: Doubleday, 1968. 


Fisher, P. I. and R. L. Lowenstein (Eds.) Race and the news media. 
University of Missouri: Freedom Information Center, 1967. 


Ginzberg, E. (Ed.) Technology and social change. New York: Columbia 
University Press, 1964. 


Gordon, T. J. The future. New York: St. Martin’s Press, 1968. 


Gordon, T. J. and H. Hayward. Initial experiments with the cross impact 
matrix method of forecasting. Futures, 1968, 1. 


Gordon, T. J. and O. Helmer. Report on a long-range forecasting study. 
Santa Monica: RAND Corporation, 1964. 


Gouldner, A. W. Theoretical requirements of the applied social sciences. 
American Sociological Review, 1957, 22. 


Gross, B. M. (Ed.) A great society? New York: Basic Books, 1969. 


Harbeson, F. and Myers, C. A. Education, manpower & economic growth: 
strategies of human_resources development. New York: 
McGraw-Hill, 1964. 


Harman, W. W. Contemporary social forces and alternative futures. Journal 
of Research & Development in Education, 1969, 2. 


Hartley, H. World energy prospects. InN. Calder (Ed.), The world in 1984. 
Baltimore: Penguin Books, 1965. 


Heilbroner, R. L. The future as history. New York: Harper, 1960. 


Helmer, O. New development in early forecasting of public problems: a new 
intellectual climate. California: RAND Corporation, 1967. 


Helmer, O. Social technology. New York: Basic Books, 1966. 


Hertz, D. B. The management science look to the future. Bulletin of the 
Institute of Management Sciences, 1964, 2. 


Hilton, A. M. (Ed.) The evolving society. New York: Institute for 
Cybercultural Research Press, 1966. 


Hofstadter, R. Social darwinism in American thought. New York: George 
Brazillier, 1959. 


Hoselitz, B. Sociological aspects of economic growth. New York: Free Press, 
1960. 


Esp) 


Implications of automation and other technological developments: a 
selected annotated bibliography. Bureau of Labor Statistics, U. S. 
Department of Labor, Bulletin No. 1319, February, 1962. 
Washington, D.C.: U.S. Government Printing Office, 1962. 


Jantsch, E. Planning and designing for the future. Futures, 1969, 1. 


Jantsch, E. Technological forecasting in perspective. Paris: Organization for 
Economic Cooperation and Development, 1966. 


Jungk, R. Outline of a European look-out institution. Council of Europe, 
1967. 


Jungk, R. and J. Galtung. Mankind 2000. London: Allen and Unwin, 1967. 


Kahn, H. On alternative world futures. In M. A. Kaplan (Ed.), New 
approaches to international relations. New York: St. Martin’s Press, 
1967. 


Kahn, H. Thinking about the unthinkable. New York: Horizon Publishing, 
1962. 


Kahn, H. and A. Wiener. The year 2000: a framework for speculation on the 
thirty-three years. New York: Macmillan, 1967. 


Katz, E. The social itinerary of technical change: two studies on the 
diffusion of innovation. Human Organization, 1961, 20. 


Landsberg, H. H., L. L. Fischman and J. L. Fisher. Resources in America’s 
future. Baltimore: Johns Hopkins Press, 1963. 


Lane, R. The decline of politics and ideology in a knowledgeable society. 
American Sociological Review, 1966, 31. 


Lasswell, H. D. The garrison state — hypothesis today. In S.P. Huntington 
(Ed.) Changing patterns of military politics. New York: Free Press, 
1962. 


Lecht, L. Manpower needs for national goals in the 1970’s. New York: F. A. 
Praeger, 1969. 


Lenz, R. C. Jr. A development of explicit methods in technological 
forecasting. S. M. Thesis, M.I.T. Sloan School of Management, 
1959, 


Lewinsohn, R. Prophets and prediction: the history of prophecy from 
Babylon to Wall Street. London: Secker & Warburg, 1961. 


Lewinsohn, R. Science, prophecy and prediction. Greenwich: Fawcett 
Publications, 1962. 


Martini, C. H. Impacts of scientific and technological innovations on the 
role of politics and government. (2nd ed.) New York: Education 
and World Affairs, 1964. 


McHale, J. The future of the future. Architectural Design, February, 1967. 
156 


Mesthene, E. G. How technology will shape the future. Science, 1968, 161. 


Mesthene, E. G. On understanding change. Technology and Culture, 1965, 
6. 


Michael, D. N. The next generation: the prospects ahead for the youth of 
today and tomorrow. New York: Vintage Books, 1965S. 


Michael, D. N. The unprepared society: planning for a precarious future. 
New York: Basic Books, 1969. 


Miller, G. A. Thinking machines: myths and actualities. The Public Interest, 
1905, 1. 

Moore, W. E. Social change. Englewood Cliffs: Prentice-Hall, 1963. 

Morris, R. and R. Binstock. Feasible planning for social change. New York: 
Columbia University Press, 1966. 


Nelson, R. R., M. J. Peck and E. D. Kalachek. Technology, economic 
growth and public policy. Washington, D.C.: Brookings Institute, 
1967, 


Ogburn, W. F. On culture and social change. Chicago: University of Chicago 
Press, 1964. 

Ong, W. J. (ed.) Knowledge and the future of man. New York: Simon and 
Schuster, 1968. 


Ozbekhan, H. Technology and man’s future. Santa Monica: Systems 
Development Corporation, 1966. 


Peterson, W. H. The future and the futurists. Harvard Business Review, 
1967, 45. 


Philipson, M. (Ed.) Automation: implications for the future. New York: 
Random House, 1962. 


Phillips, H. M. Economic and social aspects of the planning of education. 
International Social Sciences Journal, 1962, 14. 


Polak, F. L. The image of the future. New York: Oceana Publications, 1961. 
1961. 


Popper, K. R. Prediction — prophecy in the social sciences. In P. Gardener 
(Ed.), Theories in history. New York: Free Press, 1959. 


Porter, J. The vertical mosaic: an analysis of social class and power in 
Canada. Toronto: University of Toronto Press, 1965S. 


Prehoda, R. Designing the future: the role of technological forecasting. New 
York: Chilton, 1967. 


Quinn, J. B. Technological forecasting. Harvard Business Review, 1967, 45. 
Reed, W. K. The forces of impending social change. Social Service Outlook, 
1969, 4. 


LSJ 


Rogers, E. M. Diffusion of innovations. New Y ork: Free Press, 1962. 


Roslandsky, J. D. (Ed.) Genetics and the future of man. Amsterdam: 
North-Holland, 1966. 


Roslandsky, J. D. (Ed.) The control of environment. Amsterdam: 
North-Holland, 1967. 


Rostand, J. Can man be modified? Translated by J. Griffin. New York: 
Basic Books, 1959. 


Sarnoff, D. By the end of the 20th century. Fortune, 1964, 69. 


Semenov, N. N. The world of the future. Bulletin of the Atomic Scientists, 
1964, 20. 


Shapley, H. Of stars and men: the human response to an expanding 
universe. Boston: Beacon Press, 1964. 


Silk, L. S. The research revolution. San Francisco: McGraw-Hill, 1963. 


Staff of the Wall Street Journal. Here comes tomorrow: living and working 
in the year 2000. New York: Dow Jones Books, 1966. 


Staff of the Wall Street Journal. The innovators: how today’s inventors 
shape your life tomorrow. New York: Dow Jones Books, 1969. 


Steward, J. H. (Ed.) Contemporary change in traditional societies. Urbana: 
University of Illinois Press, 1967. 


Steward, J. H. Theory of culture change: the methodology of multilinear 
evolution. Urbana: University of Illinois Press, 1955. 
Stulman, J. Evolving mankind’s future. Philadelphia: Lippincott, 1968. 


Symposium on indicators of social change. New York: Russell Sage 
Foundation, 1968. 


Zechnology and the American economy, Vol. 1. National Commission on 
Technology, Automation, and Economic Progress. Washington, 
D.C.: U.S. Government Printing Office, 1966. 


Theobald, R. (Ed.) Social policies for America in the 70’s: nine divergent 
views. New York: Doubleday, 1968. 


Theobald, R. An alternative future for America. New Y ork: Swallow, 1969. 


Voyer, R. D. The Delphi technique: a valuable tool for technological 
forecasting. Science Forum, 1969, 2. 


Ware, W. H. Future computer technology and its impact. Santa Monica: 
RAND Corporation, 1966. 


Warner, A. W., D. Morse, and A. S. Eichner (Eds.) The impact of science and 
technology. New York: Columbia University Press, 1965. 


158 


Warshofsky, F. The twenty-first century: the new age of exploration. New 
York: Viking Press, 1969. 


Winthrop, H. The sociologist and the study of the future. American 
Sociologist, 1968. 


Wolstenholme, G. (Ed.) Man and his future. Boston: Little, Brown, 1963. 


Wrener, A. and H. Kahn. On studying the future effects of science. 
Encyclopedia Britannica Yearbook of Science, 1968. 


Young, M. Forecasting and the social sciences. London: Heinzman, 1968. 


159 


vive ay oe : "4 


eter 


n" 
¥ 
tae | 


was ial nit aia ° ha bi sili 


hatin ty ani bere a Hae 


x, oe Wi. Bri boce) on htt ede uy wt 


rmerten wn } ve gi 


| cn 


iy san ano f v nina i paths na ix 


Ley ope tA wih Soler ‘a 


% 
r ’ 
P sept % 
pad? 
‘ 
£ 
A ” 
{ 
¢ 
- 
hy 
1 
‘ 
i 


a a’) 


ro aa 
i% b oie "epee 3) wees 


, ‘ Ye) iat Vetess ‘ Presa, 9 6, 
1 i mg | -— 
i Te i! 5 


